By arguing black people can be racist against non-whites you've already admitted racism exists not merely as a system of oppression, but as prejudice too.

No, that doesn't follow. Oppressed people absolutely can be active and even willing participants in the systemic oppression of their own people.