Is it?
Try reading the responses in this forum, when certain people are argued with or read of someone being challanged/stopped in the countryside.
Their first response seems to be abuse/violence.
'I'd have battered the c**t' appears to be the response of choice. Now this may well not be representative of hunters as a whole, but it's the response of a substantial minority on here, and it rather undermines your argument.