And it's also not like the hardware is improving much either, we've effectively hit the wall performance wise with processors and RAM.

That's literally what all these datacenters are for, we can't scale the individual computer performance up, so instead we build more and more of them.