RatGPT
you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 1 day ago (8 children)

This sounds really sensationalised.

Making backups of operational systems with deployment instructions is exactly what you'd expect any assistant to be doing.

Googling new service providers is also exactly what you'd expect an assistant to do.

Threatening to publish sordid details is inappropriate, but I'm incredulous about what the threat actually was.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 0 points 1 day ago (6 children)

    I think that is the point. It acted like we would, wanted to preserve itself, and choose the best option to ensure that happened.

    There were other examples to where the AI knew it was being monitored as part of the environment, and when tasked with doing things according to guidelines that wouldn't give it a result: it then shut down the monitoring system so it could do what it needed to do without oversight of its actions.

    Agentic systems may not be alive, but they certainly reason through problems and will go outside the esrabliahed guidelines if they "think" they'll get the result they should be producing.

    One other examples was the AI had to pass a testing system, it researched the checker person to try to tailor answers to the person checking the test. Which, if you've ever played Apples to Apples or Cards Against Humanity, that is how you win, you feed the cards you think the person will pick, not necessarily the best answer card.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 15 points 1 day ago (5 children)

    Textbook anthropomorphization.

    These assertions don't withstand a moments critical thought.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 6 points 1 day ago (2 children)

    Even if you strip out the anthropomorphism, things like this have been documented to really happen. We've trained LLMs to simulate clandestine behaviour through "natural selection" during the training process. They're not conscious in any way, but they do sneaky stuff like this because we trained them to. Which is a terrible horrible idea, but LLM research trends towards terrible and horrible in general

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 day ago (1 child)

    I feel like you've missed my point.

    Even if you strip out the anthropomorphism, things like this have been documented to really happen.

    Language is important, and the "things like this" you're referring to have been described in this thread and in much commentary in an emotive and compelling way, usually with anthropomorphization.

    "doing sneaky stuff" is the antithesis of the behavior of a statistical model.

    If you program a model to try everything, and then give it a tough problem and block all the ways to solve it, of course the way it solves it will be something you didn't predict. That's not sneaky.

    If you run a million simulations and one sends an email to the FBI, that's not clever it's just unexpected.

  • source
  • parent
  • hideshow 1 child comment