Who is the antagonist in James Joyce by Richard Ellmann?

The primary antagonist in Joyce's life was his consistent lack of money..... there was never enough, and no matter how much he earned it always fell short.