Except there actually were people of different cultures/ethnicities/nationalities in other places in the past, often without anyone caring that much. Sure, it was often notable but it wasn't always exclusionary. Implying this shouldn't be done is the real historical fiction.