I think you can call someone saying “it’s unfair to judge people by race” a racist when they're using that line to applaud the removal of protections against institutional racism. We can argue the merits of AA as a form of protection, but it was protection nonetheless. To say that it was unfair is to entirely ignore the unfairness which necessitated its existence.

How was it not? How is non-whites having less access good?

You follow what I quoted by claiming it wasn't fair ("imo") because, as you say, "we shouldn’t raise the eligibility of people based on their race" which is great if you ignore the fact that nearly every institution in the US treats people differently based on race, whether intentional or not. It is exceedingly rare for that bias to swing in the favor of non-whites.

With no meaningful alternative to AA, what exacxtly is the win here?