Why does Fern disagree with the idea that blacks owning slaves is like owning your own family?

Fern believes that the Bible said it was okay to own slaves and the law also said it was okay. Fern also disagrees because she was a free black woman who owned slaves. However, Fern does not point this out to Frazier who believes her to be white.