What things does Boy think will ruin his family's chance to pass as white?

Boy worries that associating with Kitty's dark skinned family will ruin his chance to pass as white. He also believes that Kitty's Jamaican dinners will tip people off to their true heritage.