In what way does the Colonel think Jimmy is right in his criticism?

He acknowledges that Jimmy is probably rather accurate in calling him an "old plant" that is still hanging around from the "Edwardian wilderness," admitting that once he came back to this country everything had changed, and he was unsure of how to deal with it all.