Who is the antagonist in A Respectable Trade by Philippa Gregory?

Sir Charles is the main antagonist in the novel, A Respectable Trade. Slavery is also a major antagonist.