Who does Atticus say are part of an "exclusive society'?

Atticus says that the Ewells are a part of the "exclusive society".

"Let us leave it at this. said Atticus dryly. "You , Miss Scout Finch, are of the commonfold. You must obey the law. He said that the Ewells were members of an exclusive soceity made up of Ewells.