Why is Jameson so upset about the four digits that end up forming the clue from his grandfather?

Jameson is so upset about the four digits that end up forming the clue from his grandfather because they are not only the date of Avery's birthday, but also the date of Emily's death.