Those server farms are because the needs of corporations might just be different from the needs of regular users.

I'm running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.

It's almost as if technology can get better and more efficient over time.