See that breaks down when there are victims. Even if we stick to non human animals I'm sure you have negative opinions about some of the following: whaling, dog fighting, dog eating, skinning cats, horse racing, circus animals, pet hoarding, shark nets.

Like everyone is familiar with the idea that there are acceptable ways to seek pleasure in the world and some line beyond which they say "no you're victimising another for your own gain. I do not think that is acceptable". Even anti vegans rarely endorse arbitrary use of non human animals for pleasure.

So you are probably comfortable with the idea that you can't just say "live and let live" and be done with it. That works for whether you want to plant red roses and I want to plant pink ones, or you like toffee and I like cake. It doesn't apply when lives are on the line.

Killing/hurting beings that want to live and suffer when you don't have to is wrong. It is a wrong thing to do.