What determines whom Rick does and does not admit into his private gambling room?

Rick only lets people in that he does not find offensive. He, for example, refuses the Nazi aristocrat because of his bad attitude.