Yes there is. When your freedom directly invades the freedom of other people you are passing the threshold of what is tolerable.
When you form a group of people and declare it's free speech to discuss how women shouldn't be allowed to vote, for example, you aren't just voicing any random opinion. Words have consequences and words can hurt people. You are past the line of tolerance because you actively invade other people's freedom.
I can only imagine that thinking it's freedom to allow these talking points to freely flourish online stems from the naive believe that nothing will come of these types of echo chambers, but it does. We have already experience with this from the incel and racist mass shooters and the online communities that helped birthing them.
I don't say it's easy to decide in every case when you should put a stop to a discussion. But simply allowing everything is not the way. And ironically this squabble community realises this by also not allowing everything.