If you press the "done" button while the achievements list is scrolling, the list will close and then immediately reopen itself. The desired behavior would be for the window to stay closed.

EDIT: Nevermind. For some reason, I had an "An error has occurred" condition without any actions. When I deleted that, the problem went away. Not sure if that is a bug or not.