What about Kaoru's manner makes the women want to joke with him?

Kaoru has a very prudent manner, and the women begin calling him Lord Proper, as Kaoru has always been a very proper young man. Kaoru does not like their manner of joking with him.