Why do the kidnappers think the boys have changed places?

The outlaws believe the boys have switched places because Jemmy can read and write, whereas, the prince cannot do either. The men find it ridiculous that the whipping boy is literate and the prince is not.