Why did the Hatter fight with Time?

The Queen instigated the Mad Hatter's fight with Time.

`Well, I’d hardly finished the first verse,’ said the Hatter, `when the Queen jumped up and bawled out, “He’s murdering the time! Off with his head!”‘
`How dreadfully savage!’ exclaimed Alice.
`And ever since that,’ the Hatter went on in a mournful tone, `he won’t do a thing I ask! It’s always six o’clock now.’