Who is the antagonist in This House of Sky: Landscapes of a Western Mind by Ivan Doig?

There isn't a specific character that is an antagonist rather than life circumstances, like the death of Ivan's mother, are antagonistic forces.