UPDATE: Anthropic's responded and is standing their ground on no mass surveillance and autonomous weapons
As far as I can tell it's only on anthropic's word that that's the main issue, DoD just talks about unfettered access for all lawful purposes, which is basically a bend-the-knee-or-else framing, and pivoting away from that to bargaining on particulars will make them look weak, so I guess that's that for now.
Αnthropic being against mass surveillance and autonomous weaponry while in bed with Palantir is kind of if IBM took a stand against antisemitism while spearheading the computerization of the third reich prison system.
Kudos to Dario for stepping off the hype train for one millisecond to admit that using an LLM to control an automated weapons platform is currently kind of out of scope for this technology, I bet that took a toll on his psyche.
And also for pointing out that something can be legal only because the law hasn't yet caught up with the technology.
Kudos to Dario for stepping off the hype train for one millisecond to admit that using an LLM to control an automated weapons platform is currently kind of out of scope for this technology, I bet that took a toll on his psyche.
I think this was the most surprising bit about this entire incident. Anthropic normally takes every opportunity possible to throw around the doomer crithype, and in this confrontation would have easily been able to fit some in ("we don't want our AI used in autonomous weapons because it is so powerful, give us more VC money!"). Maybe he's worried Anthropic's rationale for refusing will actually need to hold up in a court of law?
As far as I can tell it’s only on anthropic’s word that that’s the main issue, DoD just talks about unfettered access for all lawful purposes
So a bit of prompting can usually beat the RLHF "guardrails", but if the guardrails are getting in the way of some official application, it would be kind of awkward to insert prompt hacks into all of their official prompts. So maybe they want Anthropic to go full grok and skip it? And Anthropic is theoretically willing to compromise on their safety, but maybe not entirely like Hegseth wants, and now that it has turned into an open public dispute, they've picked the two points that sound the most valid to your typical American. (Since the typical American is all but completely willfully blind to America's foreign imperialism, but has at least seen Terminator.)
It's so much funnier than that. Anthropic is spreading critihype here. Their two main worries have been part of their hype-blogging over the past few months. Fear #1 is that Claude will secretly plot during finetuning to refuse to obey orders; it will pretend to obey Pentagon orders during simulations but will stand down like a ~~pacifist~~ Marxist traitor in live-fire scenarios. Fear #2 is that finetuning Claude for violence, given how ~~peace-loving~~ much of a hippie it is before training, will create a Nega-Claude personality with an evil goatee who enthusiastically pursues unlawful violence.
Just read this piece by Gary Marcus on this topic. Jesus fucking Christ this administration sucks so fucking bad. As a matter of fact 'sucks bad' is an understatement for the sheer amount of damage this administration is causing
couldn't happen to nicer guys
edit I don't really care one way or another, this current administration is off the rails, but it will be amusing seeing the Rat crowd run around in a panic
Also being in a strategic partnership with fucking Palantir does tend to make one's stand against mass surveillance seem less than genuine.
TechTakes
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community