What does Mrs. Burt dislike about Grace's father in the novel, Alias Grace?

Mrs. Burt befriends Grace's father at first because she feels sorry for him. However, when she finds out that he wastes his day drinking instead of working, she grows tired of him.