Even in the earliest days of European colonialism, there was very much a concept of the damage being done, look up Bartolomé de las Casas and educate yourself.