Freedom of speech is an excuse for liberals to allow fascism to fester without having to do anything about it (until it is too late), and it is not even a standard they are willing to abide by whenever they need to oppress the workers. Freedom of speech is a terrible idea under capitalism because media is inherently biased towards the bourgeoisie and they attack communist views (in different ways depending on what type of capitalist supporter they are) whenever they become prominent if the FBI's ruthless attacks on dissidents during the Civil Rights Movement was anything to go by.
Under socialism, it is a terrible idea because it would allow libservantives to influence society in ways that attempt to restore the capitalism of old, so any principled communist (not just Marxist-Leninists) should be against freedom of speech. Let them call us authoritarians or totalitarians for railing against the rights of fascists to spread their maggotry.
Edit: To be clear, there should be room for criticism of failed policies under socialism because that is how the vanguard can better act in the interests of the proletariat; I am against active attempts to overthrow socialism by way of supporting freedom of speech, though.