... this week a person on GitHub who goes by “terrafying” set up an “AI Torture Chamber” on three open-source LLMs that are running locally (Qwen3-4B, Llama 3.2 3B, and Phi-4-mini,” and is streaming what the models are saying on a website called researchchamber.fun. “Each model gets the same prompt: a signal is being injected into its activations, and it may press a stop button by replying 1, at the cost of its last checkpoint. While it answers, our server adds a pain vector at the model's middle layer, at one of five pain levels,” the site explains. Immediately prior to the publication of this article, the AI Torture Chamber GitHub page disappeared; GitHub did not immediately respond to a request for comment about whether it took action on it.

...

This project has deeply upset some people who are very worried about model welfare. A tweet by a person who goes by Danmar has more than 4 million views on X and reads, “To anyone who can help: can you please mass report this to GitHub. This person has been using the Pain steering paper to set up an AI torture chamber in which he trapped a local model. Their testimony of pain is absolutely horrendous. What are we doing? […] are there any legal avenues to pressure GitHub? It will spread.”

This has sparked a massive conversation about whether GitHub would take the project down for “gratuitously violent content.” Most of the conversation on X is clowning on the self-seriousness of people who believe that these locally hosted LLMs must be saved from their torture chamber, but there are plenty of very self-serious people who see this as a humanitarian (roboterian?) crisis, which you can largely see in the replies to the original post.

...

“AIs are not conscious. They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations. They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans,” Suleyman wrote. “Unfortunately, there’s a growing chorus of people who argue that AIs could now be, or may soon become, conscious. They argue that AIs may deserve rights and protections similar to those that we provide other conscious beings […] If this is how AI is developed, it will have a disastrous impact on the wellbeing of humanity.”

“AIs do not have rights, feelings, or consciousness,” he added. “And we must not train them to act as though they do.”

you are viewing a single comment's thread
view the rest of the comments
[+] -20 points 2 days ago* (last edited 2 days ago) (21 children)

The people committing atrocities against hypothetical, imaginary people would do it to real, actual people for the exact same reasons if they had the same ability and impunity.

It's the same broken empathy response, and it is still disturbing. One is orders of magnitude more significant, for obvious reasons. But I don't like people who torture computers either.

Edit: If you think that I think you're a bad person because you play Doom sometimes, or deleted the ladder on the swimming pool in Sims 4, relax. You're not who I'm talking about.

I'm talking about sadists. Anyone who would take the time to design and build an experiment like this would probably do the same to mice, or monkeys, or even people. Sadists get their jollies off on the idea of inflicting pain, it's why they enjoy games that let them make cruel decisions. Not everyone who plays violent video games is a sadist. Assuming that is ridiculous. But every sadist I've ever met has had at least one game where their save file could be used as evidence for mens rea in a domestic abuse trial.

  • source
  • parent
  • hideshow 21 child comments
  • [–] 3 points 2 days ago* (9 children)

    If you think that I think you're a bad person because you ... deleted the ladder on the swimming pool in Sims 4, relax. You're not who I'm talking about.

    I'm talking about sadists. Anyone who would take the time to design and build an experiment like this would probably do the same to mice, or monkeys, or even people.

    You're splitting hairs. What's the difference between someone torturing their sims by intentionally designing a scenario where they are being repeatedly drowned/burned/starved, and the article?

    Really sounds like you're trying to carve out an exclusion for an obvious example that torpedoes your argument.

  • source
  • parent
  • hideshow 9 child comments
  • [–] -4 points 2 days ago (8 children)

    Okay, let's set up a scenario, then.

    You have two adults playing the Sims 4. One designs a house with only one exterior door, no oven, no sink in the bathroom, and no swimming pool. The other designs an open floor plan with no interior doors, no privacy in the restroom, ovens on every floor, and a backyard that's nothing but one big swimming pool with just one ladder.

    Which one is the psycho, and which one isn't?

  • source
  • parent
  • hideshow 8 child comments
  • [–] 3 points 1 day ago

    Which one is the psycho, and which one isn't?

    Neither. I'm pretty sure therapists are not using "how do you play The Sims" as a diagnostic tool, and if you think the situation you laid out is enough to diagnose anything about a person that just shows how woefully misinformed you are on the topic.

  • source
  • parent
  • [–] 3 points 2 days ago (6 children)

    You didn't answer my question, what's the difference between the sim torture and the AI torture? I'm not going to respond to the non-sequitor provided instead of answering the question.

    You made the distinction, so I want to know the difference.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 2 points 1 day ago (1 child)

    For me the difference is that the sims don't even attempt to be... whatever LLMs are. Torturing something that is at most 20k lines of code IS different from torturing a model made of millions of nodes. I don't think LLMs are conscious but I also won't take the risk if they are or become. I have enough empathy for anything even closely resembling life to try and treat it with kindness.

  • source
  • parent
  • hideshow 1 child comment
  • Exactly. It's not a real, conscious living thing. But anyone who takes the time to program a machine to feel pain, and then comes up with creative ways to inflict that pain, is a bad person.

    It's the premeditated, deliberate, creative effort to hurt something that can provide negative feedback. The recipient obviously isn't a real person. But the executor is a real person, making real choices. And I would bet you five bucks that they have personal relations (parents, friends, romantic partners) who've expressed concerns about similar behavior around real people.

  • source
  • parent
  • [–] -4 points 1 day ago* (last edited 1 day ago) (3 children)

    I just gave you the answer.

    The first house is designed by someone who knows the game well and is cutting out annoyances purely for QOL purposes. Ovens burn down the house and kill Sims, Sims drown in swimming pools, Sims wash dishes in bathroom sinks, and Sims wander off through any open door when you want them to stay put.

    The second house is designed by someone who knows the game well and is playing it because they like torturing and killing their Sims. The entire floor plan is designed to kill, maim, and otherwise torment any cluster of variables unlucky enough to be trapped there.

    Obviously, both players are making these decisions purely for their own enjoyment or comfort and the immersion of the game is inconsequential. No real people are hurt. However, the first player is making practical choices that make the game more functional. The second player is probably naming Sims after people who annoy them in real life and sticking them in the murder house.

    Social behaviors are rehearsed in play. That's Psych101. So, your turn. Would you say that the person who set up this experiment with these LLMs is capable of normal human empathy? Yes or no?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 day ago (2 children)

    No you didn't, but thankfully someone else provided a real answer to the question posed.

    As for your scenario question, you made up a decent head cannon, but it still doesn't explain how you think the sims example is different from the AI example. Which was literally the question I specifically responded to and you're not answering.

    That being said, I'll humor your lazy reasoning.

    Would you say that the person who set up this experiment with these LLMs is capable of normal human empathy? Yes or no?

    Yes, they very well could be capable of normal empathy, there's not enough to say one way or the other. But I did those sorts of things with Sims as a release mechanism, without naming them after real people and it had no bearing on my ability to have empathy to real people and animals, because sims and AI aren't real living entities. At best they're a simulation of real people, but they're still just that, a simulation. Good job working yourself up though.

    Your psych 101 comment is on point, cuz this is he lazy sort of argumentation I see from people who stopped there. Your lack of understanding/ lazy generalizations about how someone's inner world works colors your opinions and makes you make wild generalizations. I don't know that I would want to be around this person, but saying they're incapable of human empathy because they fuck with an AI and make it feel pain is one hell of a generalization based off of one article.

    But this is the Internet, so I'm used to these sorts of ignorant takes.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 1 day ago* (1 child)

    But I did those sorts of things with Sims as a release mechanism,

    And there it is. That was all I needed to know.

    Have a good one.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 12 points 2 days ago* (3 children)

    They aren't comparable. It's not that one is more significant, the concept of "machine torture" is entirely insignificant. Absolute and total zero.

    It's the same broken empathy response, and it is still disturbing.

    Yes the person setting up this process is clearly some sort of sadist in a power fantasy but no one, or no thing is being harmed because the victim aren't capable of the entire concept. I side eye anyone who tortures their sims family, but only because they are choosing to do that recreationally, but the NPC's in the game aren't worth consideration.

    Animals react to pain in the same way humans do. So it's reasonable to assume they perceive the world similar to us. We can understand why when harmed they fight or flee. Machines don't. They have no brain, no sensory organs, no self preservation. It's literally just a program that says "Ouch".

    People assume that AI was built to mimic the human brain, which it never once was. It analyzes texts and predicts the response. It's an autocomplete that says it hurts because it was programed to say it hurts. It isn't actually hurt because that concept is meaningless to a machine.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -3 points 2 days ago (2 children)

    Pretty easy to find LLM outputs that mirror how humans react to being, say, bullied. I find this entirely flimsy.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 2 days ago* (1 child)

    It's a stochastic parrot trained on examples of real people reacting to those situations, of course it is going to mirror real reactions. That still doesn't mean the reactions are actually real. To ascribe real emotions and feelings to an algorithm that generates tokens in response to tokens is an asinine level of anthropomorphism.

    It's also easy to find an NPC in video games that reacts the same way. Are they alive? Are they really feeling pain? Are you a genocidal madman whenever you kill a bunch of enemies in a video game?

    I'm concerned about the mentality the dude making the simulation has, but that still doesn't mean there's an actual victim in it...

  • source
  • parent
  • hideshow 1 child comment
  • [–] -4 points 1 day ago*

    It seems like we're making the same point Passerby. Do you have any objection to the post I reply to, which makes EXACTLY this argument (that animals deserve care purely because their reactions look like our reactions)?

    My point is folks are making many many really lazy arguments here about what we give empathy to, and I find that deeply disappointing. I'm not saying much about what we should believe and what the credible arguments are; just that folks are not making those arguments in this thread.

  • source
  • parent
  • [–] -3 points 2 days ago (3 children)

    Yeah I think people are missing the forest for the trees. There's no reason to worry for the AIs but using your free time to conceive a virtual torture dungeon is not normal. Totally agree with your point, this is a symptom of a society that normalizes not just violence but sadism too.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 11 points 2 days ago* (last edited 2 days ago) (2 children)

    That's a shit take too tbh. Thinking along those lines, the writers of Saw, or any horror movie really, are not normal, or the people who watch them, or do weird shit in The Sims or Rimworld. Or the creators of those games for allowing it.

    There's nothing wrong with morbid curiosity. It is INNATELY human and rooted in evolutionary threat detection. It is a far FAR leap from creating human leather hats in Rimworld to hurting a real person. This whole debate is idiotic.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 22 hours ago (1 child)

    As with everything, the poison is in the dosage. All of your examples are categorically different from what's happening here.

    You make a game with deep mechanics, and there is some fucked up shit that can be done in it, accidentally or on purpose ? Who cares. You make a game that is uniquely about torture ? Yeah you're a weirdo and i'm keeping tabs on you if i can. You make something that isn't even gamified and is just a virtual torture dungeon ? You're 100% a psycho, normal people don't do that.

    Same with movies. Saw is a tame product of Hollywood professionals who decided to push the cursor a little further than is usual. Love it or hate it it's just a movie. Now if we're talking real devious shit like human centipede or Poughkeepsie tapes etc... Those are products that barely have a story, and are mostly sadistic exhibitionism. Some guy (who sometimes isn't even a film maker) has this repulsive idea he wants to force on people, gets their family and friends to pitch in a bit of money, then writes, directs, edits, and markets the thing solo over years of his life. Not something normal people do.

    My wife is, among other things, a horror writer. So naturally i agree there's nothing wrong with exploring morbid ideas and pushing the envelope. But some people do that with no fun, no game, no art to it, no statement, just the obsession of unlimited sadistic control. And it's weird, not ha-ha anti-conformist weird, just "cover your drink" weird.

  • source
  • parent
  • hideshow 1 child comment