The real problem is that for most of western history, unskilled labor was largely performed by slaves.

Funny thing is, you balance earnings and expenses for slaves vs modern workers, and the math vastly favors the slave. But that’s bad for other reasons.