""I resigned from Anthropic today... Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt... many executives couch their phrasing in the press to sound sensible, but I hear the same people express fear privately."

Jacob Coxen senior researcher at Anthropic, previously at OpenAI

"Jacob is correct here — we really do earnestly believe AI could kill all humans. I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to."

Evan Hubinger, Anthropic alignment lead

I wouldn’t say that, the amount of vulnerabilities it’s discovering (and capable of exploiting) is frightening

This is such a wild take to be getting this many upvotes. If nothing happened in LLM development from this day forward they'd still be absurdly dangerous: both in an information security context and a social engineering context.

Lemmy is absolutely head in the sand about LLMs and it is wild. You can dislike LLMs and acknowledge their capabilities [and limitations] at the same time.