Caterpillar - Garden boon or bane?

This caterpillar and a few others of its kind are voraciously feeding on my tomato plant... which poses a sticky dilemma for the owner of the garden - should I exterminate the buggers and let my tomatoes grow in peace or leave them to mature to become beautiful butterflies at the expense of the fruits of my labor?