What is Henry's reasoning for wanting to go forward with Bardolph's execution?

When Henry hears that Bardolph had robbed a church, he insists that anyone who commits this type of crime must be "cut off." Henry explains that while the army is on the move, nothing is to be stolen and the people are not to be abused in any way.