They don't even have to be a racist. It could just be some form of racial bias. It's usually a bias that they aren't even aware of, and it gets glossed over as "the candidate wasn't a good culture fit" or something like that.