Right, that's exactly the problem I have with most people who call themselves libertarian. In a nutshell, they truly believe that we all should get to do whatever we want, as long as it doesn't affect others. Except, everything we do affects other people. Some of the ways are profound, and some are trivial. The libertarian-type people are so selfish, or solipsistic, they think that only their own judgement applies whether the effect infringes freedom it not.

We see that with vaccines: The government shouldn't mandate what they put in their bodies. That's infringes freedom. But they're more than happy to spread virus into other people's bodies, and if immuno-compromised people think that it's hurting them, too bad. Or the libertarian types think that they should be allowed to drive the biggest brodozer available, because it doesn't affect anybody else, and the freedom of other people who get hit and crushed under the wheels, the other drivers blinded by eye-level headlights, or the taxpayers who have to subsidize more free parking space and street maintenance, doesn't matter.

It's always the same pattern: Anything that stops me from doing what I want is an unreasonable infringement of freedom, and any effects I have on other people are just the reality of living in society and they should suck it up.