I blocked them with an extension in Firefox and it has improved my YouTube viewing experience, well, back to how it was before shorts, but still not quite as good as it was when we could still see downvotes.