The problem isn't AI gaining intelligence, it's allowing AI to have agency and then it gets an potentially dangerous prompt that leads it to hack into, just for the sake of being funny, a bunch of places to delete the entire stock market. As funny as it would be it would lead to a complete economic collapse. I'd actually feel safer if it did have actual intelligence. We're talking about a technology where if you have broken unit tests (software term meaning a certain set of tests the code has to pass to be considered functional) and you tell AI to "fix the unit tests" there's a non-zero chance of it just deleting the tests and saying it's fixed.

AI is dangerous not in the way movies present it where it gains sentience and wipes us out. It's dangerous in the opposite way where it doesn't have intelligence and wipes us out because it doesn't understand it's doing something that's going to kill us.

The reason AI is a danger is because it's dumb.

They're literally giving it bombs and complete autonomy in drones already

What happens when you give a very unintelligent baby a chambered pistol with the safety off? Now do that with tens of thousands of babies.

https://techcrunch.com/2026/09/18/ai-hallucination-nearly-triggers-us-military-operation/

I'm just going to leave this here.

Those are both valid threats however we've also seen LLM agents so some really dangerous stuff with hacking already. They can do a lot of damage to the world just by messing with software. If they attacked the right places the global economy could literally collapse. We're thoroughly dependent on software to keep nearly everything running these days.

AI Usage should almost be like that teacher that was really good at school. Engaging you to make you better, not replacing you or brainrotting to hell.

I do think the two professions that are likely about to die however are customer service (not all, just 90% of call centre workers) and non-tool assisted programmers.

AI coding is going to be the future but instead of just big corporations doing it people should be using it for building out tools they need. AI in it's current state is just a smart printer and I'm sure there are a lot of business ideas we haven't even come up with yet that will make humans and AI complementary, not one to replace another.

I would rather not have AI at all, but pandora's box is already open and if we don't at least try and integrate it into our workflows we will be left behind.