765
Google's Agentic AI wipes user's entire HDD without permission in catastrophic failure (www.tomshardware.com)
submitted 10 months ago by to c/technology@lemmy.world
178 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 10 months ago (5 children)

in your example tho it would be like the plumber asked you specifically if he could bone, and you were like "sure dawg sounds good"

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 3 points 10 months ago (4 children)

    No, not at all

    I get what you are saying but any reasonable entity would understand that telling someone at the door "come in", does not mean "come in my wife's ass"

    Specifically the "without permission" in the title, relates to the fact the AI did not ask about it... it simply took a previously granted right to run commands and ran any/all commands without warning.

    If you and I were working on a project together and nothing is working right, I could say "hmm let's start over" and you would know it means "let's start the project from scratch", not "let's wipe the data centre"

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 10 months ago (3 children)

    Inviting an agentic AI isn't really asking them to do one task, though.

    It's more like offering a plumber a room in your house to stay in 24/7 so they can be on-call when you need them. And telling them they can use your food, dishes, clothes, and living room while they're there and you're at work.

    Which makes it much less surprising when they get bored and bone your wife.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 10 months ago (2 children)

    It’s more like offering a plumber a room in your house to stay in 24/7 so they can be on-call when you need them.

    Again I get your point... but no reasonable plumber would make that mistake.

    If I invite the dumbest plumber alive into my home, show him the leaky tub and say "I have to work but do whatever you need"... they would understand the context to mean "do whatever you need to fix the tub"... I doubt they would go make themselves a sandwich, grab a beer from the fridge and invite their buddies for a BBQ at my place and then say "but you said I could do whatever I needed"

    I absolutely understand what happened here. The point is there is no benefit to these Agentic AIs because they need to be as supervised as a monkey with a knife... why would I ever want that? let alone need that

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 10 months ago (1 child)

    Again I get your point… but no reasonable plumber would make that mistake.

    To extend your analogy, agentic AI isn't the "reasonable plumber", its the sketchy guy that says he can fix plumbing and upon arrival he admits he's a meth addict that hasn't slept in 3 days and is seeing "the shadow people" standing right there in the room with you.

    I absolutely understand what happened here. The point is there is no benefit to these Agentic AIs because they need to be as supervised as a monkey with a knife… why would I ever want that? let alone need that

    I can see applications for agentic AI, but they can't be handed the keys to the kingdom. You put them in an indestructible room with a hammer and a pile of rocks and say "please crush any rock I hand you to be no bigger than a walnut and no smaller than an almond". In IT terms, the agenic AI could run under a restrictive service account so that even if they went off the rails they wouldn't be able to damage any thing you cared about.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •