When did the relationship between the five brothers deteriorate in the novel, The Man-Eater of Malgudi?

After Nataraj's grandmother's death, the family unity between the five brothers and their families quickly deteriorated.