Why was Charlie Shaw arrested in Jackson, Mississippi in the novel, White Tears?

Charlie Shaw visited Jackson in order to record music in a studio there. While in Jackson, he was arrested for accidentally wandering into a white neighborhood and forced to provide free physical labor to the Wallace family.