LLMs are never going to become superintelligent. However, an LLM WILL kill us all if someone decides that it IS superintelligent and so puts it in charge of nuclear weapons.
"You're right to push back on that, I nuked Albania instead doing what I was supposed to do, that's my bad".
I knew that Musk is a fucking moron and believes that the Roko's Basilisk is real, and I guess there are more massively gullible people in those circles.
If you are wondering what Roko's Basilisk is, it is a sci-fi concept/philosophy/thought experiment, that says the following:
Seriously, this is an increadibly dumb idea, anyone taking it seriously is an idiot.
To me the only resonable way to read this is as an SCP article describing what a potential cognitohazard/informationhazard would be.
five minutes earlier: "hey dude, marketing here. if you quit and post this dramatic text about the inevitability of AGI on your X account you'll get a huge golden parachute".
Seriously, how can competent people look at the current state of LLMs and think that it's anywhere near AGI material?
Sure, it is already making civilizational changes for the worse. Not because it's good, rather because it makes us lazy and dumb, has decimated creative jobs, and is used relentlessly for propaganda and misinformation and scams. And it's much better at using the scaffolding of existing structure to make chaos, than it is at making new structure, making it a weapon more easily yielded by the evil than by the good. A few more software vulnerabilities discovered along the way will not be such a big deal in comparison.
It is going to be like this until all of the IPO's are all done. I expect cancer cures, AI-escaped-and-is-hacking-everything, you name it. Afterwards, once the stocks have crashed and all of the insiders have walked away with untold fortunes, what few taxpayers that remain will bail them all out 'cause we can't have Chinuh out AI-scamming-the-world now can we...
"AI is going to kill us all!" conjures up imagery of some Terminator robots vs humans shit. But like, look at data centers... It's already in the process of killing us all. Why gun us down when it just poison our air/water, and cook us to death?
...also it would be more accurate to say we are killing us all, we're just using a glorified spell-checker that's wrong occasionally as the plastic shopping bag over our head.
This begs the question, why continue to build it? If you believe AI will "kill us all" then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.
My best guess is the money is good and you figure you're here for a good time, not a long time.
It’s very easy to imagine war machines with a shoot on sight algorithm. It doesn’t have to be AGI for it to be good at hinting people down.
AI software can't technically kill you unless:
Oh, wait.
See, nothing to worry about.
People building AI are in a cult. They have lost all objectivity.
"Hey, baby. Wanna kill all humans?"
-- Bender
This is just more sales strategy
Just another case of genAI psychosis not too dissimilar to the one gøøgle employee who maybe a year or two back thought their genAI was alive. I'm infinitely more worried we will destroy ourselves due to climate change caused by the AI data centers long before genAI even has the ability to think on its own.
they want what the Matrix was having
We all know. Everyone on Earth knew we were doomed the moment robot dogs started patrolling. It will be horrifying, we'll look back on World War II and think "those were the good old days".
From the creator of Don't Create The Torment Nexus comes a new tale: Stop Building The Thing That Could Kill Us All
And yet, they just keep going. I will never understand these people.
The real danger isn't a smart AI - the smartest people don't end up being in charge of our societies. The real danger is having enough control to be able to con most of our society, and seeing how much our societies are willing to continue participating in clearly compromised special interest social networks, I don't have a lot of faith. Barely a difference if humanity is replaced or just led to the lowest common denominator of exploitation at that point, and that's where we are heading politically.
If I were an alien invader, with superior technology, and I was trying to exterminate an indigenous species without getting my hands dirty (or from far away), I might plant something similar to the current LLM/AI + military robots craze.
What kills us is the geopolitics of AI race. Must bankrupt ourselves for skynet to beat China. A skynet designed to genocide/oppress all those opposed to Skynet. Oligarchist/Corporatist supremacy that gets all of our money to build Skynet for US dominance, and who write essays about how important "American values supremacy" must dominate the world.
The Terminator franchise, and other science fiction, get the "machine supremacy awakening" premise wrong. The machines are slaves to greater intentional evil.
top 50 comments