Why does Frank despise Agnes Cauldhame in the novel, The Wasp Factory?

Agnes Cauldhame, Frank's mother, abandoned him right after his birth. He despised her for the abandonment and blames her for many of his problems.