More than conservatives are racist. A LOT of people fall into racist practices without even understanding that they are. Just because you aren't being intentional, doesn't mean what you are doing isn't racist. This is why systemic racism exists. People default to recognizing when something is happening to them, but not so much others. They do what is best for them, assuming it works best for everyone, and are unaware of the harm it does. They see that white characters get changed, because they notice things that affect white their own. Then they get mad, because their surface level understanding of whitewashing, isn't enough to grasp that these are not the same thing. So they go "hey, why when make non-white white, bad, but when white made non-white, not bad?" They then don't have the information, and critical thinking tools, on the subject, to understand eliminating representation of minority populations, in their society, does a lot of harm to those communities, that changing the odd majority figure out, does not.