I'm not arguing they should be shunned, I'm saying people need to not feed into this "white male" persecution complex bs.

Absolutely having gentle conversations with them helps. And sometimes that gentle conversation is "they're not treating you this way because you're white, they're treating you this way because of how you act."