Those might be comparable in the sense that if someone called me a terrorist, I'd sooner try to challenge the assumptions that led them to make the claim than the claim itself because I understand why they'd call me a terrorist (or an antisemite) but I believe those reasons are frivolous and easily dismissed. But I'd be much more careful trying to lean into being called an antisemite, when called a terrorist I might say "and I'd fly those planes into the towers again" but I would never say something similar when called an antisemite.