There's something do disentangle about "go back to your country" presumably being entangled with Nazi rhetoric about Jews. Therefore criticisms of Israel and the desire for its dissolution as a result of its actions of a supremacist, apartheid state doing a genocide link you to the... critiques of the Nazis.
Which would be bad, of course, because the implication being the persecuted Jews of Europe just fucking loved to genocide and they're just going to be genocidal whether they're in Europe or the Middle East. This would therefore give breathe to neo-Nazis who go "see, Hitler was right to object!" Hitler did not, in fact, dislike them for the content of their character.
