“But, dear, if he got lost, how would we ever explain to his aunt and uncle?”
“They wouldn’t mind,” Harry reassured her. “Dudley would think it was a brilliant joke if I got lost up a chimney, don’t worry about that —”

Harry Potter and the Chamber of Secrets - Chapter 4 : At Flourish and Blotts
See this quote in the Pensive -