This is another major point of the game I think, when you either say yes to remembering, or no to forgetting or just to move on. I'm not really sure if this affects the game in any huge way, but I chose to remember, since the prophet from the beginning makes it a point to ask you to remember, I mean forgetting would seem counter to what you were sent to do in the first place.