I think you're really onto something with this. "Unfair" really does seem to sum up their objections to single party states, and not allowing reactionaries voices.

In the US for example free soeech brainworms are drummed into young peoples heads with the idea of fairness. KKK member has to have free speech too or maybe you wouldn't. It has to be fair. The content if the speech doesn't matter.

That example isnt hyperbole for anyone who doesn't know, thats the literal court case they use to talk about free speech. A KKK member had a show on local access cable and sued when he was kicked off air. Got to be fair. It would be authoritarian to not let reactionaries speak