OH MY GOD I can't believe I'm so baked I mentally swapped Civ and AoE. Yes, I meant Civilization, lmao.
But yeah, we're in agreement. Having truly uninhabited worlds to expand to is what makes it not colonialism. That just wouldn't work for a game set on earth because there just wasn't really any uninhabited land to expand to.