People knew. Then everything started being "i need people to work in my factory/office doing the same thing again and again" and everyone had to be the same.
Edit: Think of all the advancement in science from people that were not "normal", now they'd have just failed basic school and never had any chances to do academia. I think Einstein failed history and other subjects in a college entrance but excelled in physics and math.