Humans interfere
de facto with wildlife by changing the habitat, by modifying the climate, by producing unnatural materials and dumping them over the face of the planet.
Without 'civilised' human intervention, the numbers and distribution of other species would be very different. [At an early stage of development, of course, humans probably had minimal and local effect on population and community composition of other species.]
So we are interefering whether we intend to or not. I think what is being asked here is, 'Do we intervene on an individual basis to deter, deflect or kill particular animals (and plants?) in our neighbourhood?'.
Yes, I would certainly deter every grey squirrel in my area

and I don't worry when I frighten wood pigeons off of the bird food - which is the bigger interference, providing food for some birds/mammals or scaring them off selectively?