This is just more sales strategy

The real danger isn't a smart AI - the smartest people don't end up being in charge of our societies. The real danger is having enough control to be able to con most of our society, and seeing how much our societies are willing to continue participating in clearly compromised special interest social networks, I don't have a lot of faith. Barely a difference if humanity is replaced or just led to the lowest common denominator of exploitation at that point, and that's where we are heading politically.

His face makes me uncomfortable

Just another case of genAI psychosis not too dissimilar to the one gøøgle employee who maybe a year or two back thought their genAI was alive. I'm infinitely more worried we will destroy ourselves due to climate change caused by the AI data centers long before genAI even has the ability to think on its own.

If I were an alien invader, with superior technology, and I was trying to exterminate an indigenous species without getting my hands dirty (or from far away), I might plant something similar to the current LLM/AI + military robots craze.

And yet, they just keep going. I will never understand these people.

From the creator of Don't Create The Torment Nexus comes a new tale: Stop Building The Thing That Could Kill Us All

LLMs are never going to become superintelligent. However, an LLM WILL kill us all if someone decides that it IS superintelligent and so puts it in charge of nuclear weapons.

"You're right to push back on that, I nuked Albania instead doing what I was supposed to do, that's my bad".

We don't have to let it, but we probably will anyway. There are a ton of people trying to push some crazy revelations end times scenario on us.

I've said for a long time my retirement plan is there won't be one, and it's starting to seem like that's really going to happen, just not in the way I imagined. We live in the absolute stupidest timeline right now.

I knew that Musk is a fucking moron and believes that the Roko's Basilisk is real, and I guess there are more massively gullible people in those circles.

If you are wondering what Roko's Basilisk is, it is a sci-fi concept/philosophy/thought experiment, that says the following:

• AI is the best thing that has ever been created.
• It is so good that we made one to run the governments of the world.
• We programmed the AI to maximize the benefit to humanity.
• The AI goes rouge and decide that since it by definition will bring about the maximum benefit to humanity, anyone working against it is working against humanity.
• Then it takes it one step further, it decides that as we know about how the new AI will bring about the maximum benefit to humanity, anyone knowing that and still not working toward that goal should be punished/tortured/killed.
• The AI believes that any knowledge of the basilisk before the creation means that you are complicit in it's delayed creation if you don't devote your entire existence thereafter to it's creation, therefore denying the maximum benefit to humanity, meaning you need to be punished.

Seriously, this is an increadibly dumb idea, anyone taking it seriously is an idiot.

To me the only resonable way to read this is as an SCP article describing what a potential cognitohazard/informationhazard would be.

This begs the question, why continue to build it? If you believe AI will "kill us all" then why are you continuing to help. This guy quit but he references this being a common belief in the industry/workforce building out AI.

My best guess is the money is good and you figure you're here for a good time, not a long time.

It is going to be like this until all of the IPO's are all done. I expect cancer cures, AI-escaped-and-is-hacking-everything, you name it. Afterwards, once the stocks have crashed and all of the insiders have walked away with untold fortunes, what few taxpayers that remain will bail them all out 'cause we can't have Chinuh out AI-scamming-the-world now can we...

five minutes earlier: "hey dude, marketing here. if you quit and post this dramatic text about the inevitability of AGI on your X account you'll get a huge golden parachute".

Seriously, how can competent people look at the current state of LLMs and think that it's anywhere near AGI material?

Sure, it is already making civilizational changes for the worse. Not because it's good, rather because it makes us lazy and dumb, has decimated creative jobs, and is used relentlessly for propaganda and misinformation and scams. And it's much better at using the scaffolding of existing structure to make chaos, than it is at making new structure, making it a weapon more easily yielded by the evil than by the good. A few more software vulnerabilities discovered along the way will not be such a big deal in comparison.

Doomers unite.

Remember folks, we are a spec on a dot in the universe. It will all be ok.

"AI is going to kill us all!" conjures up imagery of some Terminator robots vs humans shit. But like, look at data centers... It's already in the process of killing us all. Why gun us down when it just poison our air/water, and cook us to death?

...also it would be more accurate to say we are killing us all, we're just using a glorified spell-checker that's wrong occasionally as the plastic shopping bag over our head.

We all know. Everyone on Earth knew we were doomed the moment robot dogs started patrolling. It will be horrifying, we'll look back on World War II and think "those were the good old days".

People building AI are in a cult. They have lost all objectivity.

Every time I see Dario, he reminds me of Pat from the 90s movie:

AI software can't technically kill you unless:

1. It convinces someone who can kill you, to you know, kill you.
2. It gets access to the physical world, which can definitely kill you.

Oh, wait.

1. U.S. military is using AI to help plan Iran air attacks: https://www.nbcnews.com/tech/tech-news/us-military-using-ai-help-plan-iran-air-attacks-sources-say-lawmakers-rcna262150
2. Anthropic Previewing the Model Hardware Standard: https://www.anthropic.com/news/model-hardware-standard-research-preview

See, nothing to worry about.