Why did Charicles not want to speak with Elisha at first?

When Charicles speaks in Antioch, he notices Elisha in the crowd only as an old man with white hair and a ravaged face. He is put off by Elisha's appearance. Charicles becomes interested in speaking to Elisha after Elisha introduces himself to discuss philosophy.