Who is the antagonist in the memoir, Victory. Stand!?

The memoir does not include a tradtional antagonist, but rather, is centered around Tommie's experiences with prejudice and racism.