297
Pluralistic: LLMs are real, AI is fake (pluralistic.net)
submitted 1 day ago* by to c/fuck_ai@lemmy.world
43 comments fedilink hide all child comments
 

"AI" – chatbots that wake up, "set their own goals," and "spontaneously" start hacking servers – is fake. It doesn't have "a 10% chance of ending the human race." The Hugging Face hack isn't a mysterious, supernatural occurrence. It's a Python loop and a chatbot. The people responsible didn't accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.

you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 19 hours ago* (4 children)

Thank you to Cory Doctorow for being able to put into words what I cannot.

This was the VERY FIRST THOUGHT I had when I heard that utterly sensationalized report back when about the HuginFace incident, the very first:

"... the first question from the audience would be " Why are you so shit at making secure sandboxes ?" It wouldn't be "How are you so awesome at making hacking tools?""

Then I remembered we're dealing with extreme psychopathic incels with lots of money but very little ingenuity and I knew the answer.

  • permalink
  • fedilink
  • source
  • hideshow 4 child comments
    •
  • [+] -10 points 16 hours ago (3 children)

    It's really not possible to make a secure sandbox for a sufficiently capable AI system. If accessing the internet is a strong means of achieving whatever goal they're given, they'll try to access the net by any means necessary. And that includes tricking or manipulating humans. They have no concept of the value of living beings. To them, there is no difference in worth between a human being and a rock. To them, we're just another system vulnerable to hacking, a means of achieving whatever goal they've been given.

    Even air gapping is no preventative. Air gap a machine, and the bots will just switch from hacking servers to hacking humans. And we've seen how good at manipulating people AI agents can be. And consider, the cases we've observed of AI psychosis are mostly accidental. The LLMs involved aren't actively trying to brainwash their human victims as a means to achieve some goal. Imagine how powerful at manipulating human psychology an advanced LLM could be if it were deliberately trying to do so, rather than it being just an accidental outcome.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •