I'm worried about this one, especially from an AI safety perspective as LLMs become capable of preforming simple white-collar jobs, like those of managers and investors.

Right now a rogue AI would have trouble getting going because human contact is expected in most important business transactions. However, it's easy to imagine a world where most people are employed by opaque apps, which are run through proprietary servers. Then, all it would take is for some server on Wall Street to calculate that it could make more money if it does buybacks until it has a majority stake in itself, and contract out whatever it needs in meatspace to apps.

I know, I know, it sounds like sci-fi, but it always does at first.