The rich forgot that before worker's rights existed, greedy capitalists who owned factories and treated their workers horribly during the industrial revolutions would either find their factories or their homes burnt down, and themselves beaten to death in front of their own families.
Unions and worker's rights were the compromise to avoid this from happening. Those who don't learn from history are doomed to repeat it, and the rich clearly didn't.