Just about all prejudice is just manufactured cultural pressure. There's no base in reality or rationality, it's just "people told me this often enough that now I believe it." It easily shifts from culture to culture because different people said different baseless things that became "common knowledge" in that region.