Why does Bob hate walking past the animal shelter in the novel, The One and Only Bob?

Bob hates walking by the animal shelter because it reminds him of his past, when he was alone and frightened.