Because that would be political to allow Russia in, but also it would be political to ban the entity from the games too. So in an effort to be as unpolitical as possible we banned some countries for some invasions and kept some countries for some invasions.

The Olympics and FIFA are totally apolitical organizations btw.