What kind of relationship did James seem to have with his father?

It seems that James had a poor relationship with his father. When he talks to the younger version of himself, it is obvious that James had a very demanding father. He would only accept the best from his family and felt that he was owed nothing less than that.