You are not entitled to an audience, people who want to see less of some things are allowed to see less of it.
Yes accountability, etc, is needed. The variant I'm in favor of is stuff like a content addressed protocol where you can "fork" a forum to substitute misbehaving mods (or server admins). But removing layers of moderation can not be a solution. Bluesky's atproto has similar mechanisms but there's not a lot of activity in making forum-shaped sites with it.