How did Epps (Fassbender) maintain control over his slaves?

Epps was a cruel man. "Rarely that a day passed without one or more whippings,” and when he was drunk, he would wake his slaves up at all times of the night, after which, he would force them to dance.