Honestly, that's maybe worse. If you're using it to say something bad about someone else, that means it's a bad thing and should be condemned. The people who it is actually meant to apply to (in its original meaning) then see them, as a group, as a thing that is insulting to even be associated with.

It's wild how hard critical thought is for some people while discussing a word about intelligence...