Just ignore/downvote/argue them. Whatever you prefer and have the energy for. I don't believe blocking people just because they disagree or annoy you is a good mindset to have personally. You're just setting yourself up to just browse in an echo chamber.

I remember a few months ago there was a post on Asklemmy where the person talked about how they enjoyed talking to an AI chatbot more than human interaction. During the course of the discussion it came out that this person had some incredibly crappy views on things like politics and human loss. This person admitted to blocking over 500 people on Lemmy because of it, and it's likely gone up since then. Blocking people just sets one up to have that kind of mindset.