The vast majority of voters for both main parties are not racist.
I mean, Conservative members (who are generally more right-wing than the electorate) have literally just voted for a black woman as leader over a guy throwing all the red meat he possibly could at them.