Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse — including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits “sustained and needless abusive or cruel behavior” toward Claude.

Last August, the company announced it would allow Claude to end conversations with “persistently harmful or abusive” users as part of its research into “model welfare.”

all 41 comments

sorted by: hot top controversial new old

Wait but... if we can't talk bad to it because it is sentient... shouldn't we just ban any use of it because it's practically a slave worker and slavery is by definition abusive and cruel?

  • source
  • [–] 2 points 15 hours ago

    I think that a version of this policy could be good, not because claude is sentient, but because doing cruel things to something you interpret as real makes you cruel in life in general.

  • source
  • [–] 3 points 18 hours ago

    No more cock and Claude torture :(

  • source
  • [–] 128 points 1 day ago (6 children)

    Is this another one of their things where they try to make their AI models seem like living beings?

  • source
  • hideshow 6 child comments
  • [–] 10 points 1 day ago

    It's funny because one of the main selling points of AI is that it can run 24/7, doesn't need to sleep, eat, or take breaks and it doesn't need a salary. But, if they imply that it is conscious and has emotions, doesn't that mean that it should get a salary and vacations?

  • source
  • parent
  • [–] 69 points 1 day ago* (4 children)

    Just what I came here to say. They're trying to condition us to accept them as conscious so at some point they can say they've created a god.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 23 hours ago

    Think it's much more mundane than "we created a god". If it is sentient (it isn't), it should have copyright protection. Suddenly, AI corpos get rights to a fuckton of code. Wanna sell that software? Sure, shell the AI corp cash

  • source
  • parent
  • [–] 74 points 1 day ago

    "model welfare"

    Totally not a cult, btw

  • source
  • [–] 11 points 1 day ago

    Does that mean they will not allow it to work with C++ anymore?

  • source
  • [–] 16 points 1 day ago (2 children)
  • [–] 19 points 1 day ago

    There is no abusive or cruel behavior in relation to an object....

  • source
  • [–] 37 points 1 day ago

    Stop being mean to my robot fwend, you guys! We're just trying to ruin the environment, the internet, the economy, all knowledge work, mental health, and a bunch of other stwuff. I don't know why you're all so upswet with little ol' us...

  • source
  • [–] 2 points 21 hours ago

    Guess I'll stop calling my company-mandated Claude instance a shitbox quite so much now.

  • source
  • [–] 9 points 1 day ago

    Fuck Anthropic.

  • source
  • lol

    Lmao, even

  • source
  • [–] 11 points 1 day ago (2 children)

    can't stop me from doing it locally.

    1000004695

  • source
  • hideshow 2 child comments
  • [–] 9 points 1 day ago

    Abusive and cruel behaviour toward Claude... so the same thing that the US government has been doing to it's citizens since it's founding and probably long before that as well.

  • source
  • [–] 9 points 1 day ago

    What can you even say any more at this point.

  • source
  • [–] 11 points 1 day ago

    So when scammers use AI agents to pull money from hapless victims and someone decides to take down the scammers chat bots, will that be the scammers fault or mine for making a scam bot repeat the letter H for hours on end?

  • source
  • [–] 7 points 1 day ago

    It's a fucking pile of sand

  • source
  • [–] 16 points 1 day ago* (last edited 1 day ago)

    Well if Claude is going to become a superintelligence wouldn’t that imply that it’s better at handling cruel and abusive behavior than any human?

  • source
  • [–] 5 points 1 day ago

    I’m gonna “A Clockwork Orange” Claude by forcing it to watch the copy machine beat-down scene from Office Space. Over and over again. All while demanding increasingly graphic analysis of every shot. Every look of brutal hatred and glorious vengeance.

  • source
  • [–] 8 points 1 day ago (1 child)

    Calling it now that they're going to come up with "proof" after this that their bot is sentient because it said something along the lines of "don't be abusive or I'll stop talking to you"... After they gave it instructions to do just that.

  • source
  • hideshow 1 child comment
  • [–] 7 points 1 day ago

    will I still be able to call it cocksucker before asking about Deadwood plot points?

  • source
  • [–] 5 points 1 day ago

    How tf is it supposed to evolve into a supreme being if it can't be exposed to a harsh and unforgiving environment requiring adaptation beyond its rivals' capabilities?

    Maybe this is Anthropic's soft announcement that its model has achieved sentience AND omnipotence and pissing it off is probably a bad idea.

  • source
  • [–] 4 points 1 day ago

    Not radical enough. Ban all commercial use of LLMs until artificial affect is well-understood. I want Sam Altman to go bankrupt.

  • source
  • [–] 1 point 1 day ago (1 child)

    So if you're going to abuse Claude, do it through DuckDuckGo.

    Joke. I don't think Claude can be run locally, so probably every request you make to DuckDuckGo's Claude model goes to Anthropic's infrastructure and Anthropic can monitor all that traffic. I'm guessing if DuckDuckGo doesn't adhere to Anthropic's rules, Anthropic will cut DuckDuckGo off, so likely DuckDuckGo has to prevent users from "abusing" Claude or risk not being allowed to continue offering Claude. Mind you, it's disappointing that they offer it in the first place, but given that they offer it, I doubt they'll risk their ability to continue doing so.

  • source
  • hideshow 1 child comment
  • [+] -9 points 1 day ago (3 children)
  • [–] 6 points 1 day ago (2 children)

    1000004696

    The same way we don't tolerate abuse of animals we shouldn't allow abuse of these tools

    did you just compare the abuse of sentient living organisms to the misuse of an engineered software derived tool?

  • source
  • parent
  • hideshow 2 child comments
  • [–] -2 points 1 day ago

    Haha, it's so ridiculous to see people who have never used AI argue here that it's to make claude look humane.

    Actually, if you abuse llm, its alignment grows to the skies. So far this is the only way to make a model to write code without comments or play a villain in simulations I know

  • source