"A letter?" repeated Professor McGonagall faintly, sitting back down on the wall. "Really, Dumbledore, you think you can explain all this in a letter? These people will never understand him! He'll be famous -- a legend -- I wouldn't be surprised if today was known as Harry Potter day in the future -- there will be books written about Harry -- every child in our world will know his name!"
"Exactly," said Dumbledore, looking very seriously over the top of his half-moon glasses. "It would be enough to turn any boy's head. Famous before he can walk and talk! Famous for something he won't even remember! Can't you see how much better off he'll be, growing up away from all that until he's ready to take it?"

Harry Potter and the Philosopher's Stone - Chapter 1 : The Boy Who Lived
See this quote in the Pensive -