Why do the children think Count Olaf wants to poison them?

When Count Olaf gives the children a special treat at breakfast..... raspberries, which leads them to believe the raspberries have been poisoned.