“If a man does not keep pace with his companions, perhaps it is because he hears a different drummer.”

Thoreau uses the drummer as a figure for the different pace that conscience sets for an individual. The passage appears in the chapter on solitude, where he is defending the right to walk at one's own speed.