Kaare we have the same problem here for a few years on my own land. We started doing things right, scouting, only shooting mature deer ect. We were always getting a few big bucks every year and would hang them in the tree and celebrate. Well for the last 2 years when the groups around us would know I was gone back to the city as this is my cottage land, they would be all over our place trying to get a big one, we had trail cam pics and neighbors telling us.
Now when we get a big one it gets put in the garage and taken out at night, we celebrate in private and when asked how the hunting is going just say ah could be better. People and even good friends change when it comes to hunting not sure why but have seen it ruin allot of good friendships.