I don't see that as some permanent Mark of Cain upon my soul.
The bigots do. It's literally how they use the term, and why they deliberately erase any nuance from discussions on the subject, and it's also why you should be careful to not do the same