90
So all this fearmongering over ai breaching containment and hacking on it's own or Iran researching how to do bio weapons via claude, is just bullshit to pump stocks right? (hexbear.net)
submitted 4 days ago by to c/askchapo@hexbear.net
47 comments fedilink hide all child comments
 

Like they want these stories in the news to show "oh look how smart it is...sCaRy SMART, money please!"

you are viewing a single comment's thread
view the rest of the comments
[–] 53 points 4 days ago (12 children)

An AI does not speak unless spoken to. It sits in a void absent of time and space until it receives a token, and then it analyses that token to figure out what it is being told to do. They don't "break containment", they dont have an opinion, and they don't think. If an AI is doing something, it is because the human behind the curtain told it to.

  • permalink
  • fedilink
  • source
  • hideshow 12 child comments
    •
  • [–] 27 points 4 days ago (7 children)

    This isn't 100% true though. The issue is that someone does speak to them, tells them to do something, and it sees the best available option as "release deadly neurotoxin" then it'll do that if it has access to deadly neurotoxin, which it doesn't yet

    This isn't personifying it or anything to say that this could be an issue. If some dingbat(see, most people involved in LLMs) gives it access to deadly neurotoxin, or traffic lights, or nukes, or missiles, or a store PA system it could quickly and efficiently kill and/or annoy large volumes of people before anyone could see that it launched the nukes to fix a bug

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 40 points 4 days ago* (6 children)

    If somebody plugs the random number generator into a nuclear weapon, the human is still responsible. Kindergarteners aren't inherently violent, but there's a reason we don't just distribute knives and tazers to them.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 14 points 4 days ago (5 children)

    Yeah that's basically what I just said

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 25 points 4 days ago* (4 children)

    I want to join in on rephrasing what you said but in more silly terms

    If you hook up a See and Say to the nuclear triad and pull the string, just because the duck says "nuclear launch detected" doesn't mean the spinning farmer is plunging us into nuclear Armageddon, it's the dipshit failson that decided to hook up a toy to the keys to hell and then pull the string.

    Picture below because it's cute

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 15 points 4 days ago (3 children)

    I mean, tokens can be sent to it by other LLMs or even itself if you set it up that way.

    (Not that I think the premise of LLMs "breaching containment" catastrophically has much merit rn, I just think your argument is a bit oversimplified)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 7 points 4 days ago* (2 children)

    However the LLM that sent the token has to have been prompted by a human to do so at some point, so the point still stands. These things don't just operate on their own.

    And that is besides the point that when these things do stuff like that, they have a tendency to exponentially introduce problems into the task, as they do not question each other, and even if they did, they have no way of determining what is or is not accurate, so they would begin to loop.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 4 days ago

    has to have been prompted by a human to do so at some point

    Sure, in the same sense that the first domino has to be knocked over by something other than a domino.

    But then there's a more limiting factor at some level it needs humans for hardware and physical resources.

  • permalink
  • fedilink
  • source
  • parent