1293
Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue (www.tomshardware.com)
submitted 4 months ago by to c/technology@lemmy.world
345 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 31 points 4 months ago (8 children)

it thinks

I'm not attacking you but we really need to figure out how we use language to accurately describe what these programs are doing.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 11 points 4 months ago (6 children)

    They are outputting a highly likely sequence of words that fit the type of output from their training data that matches the input.

    They are fancy autocomplete.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [+] -10 points 4 months ago (4 children)

    They are fancy autocomplete.

    ... and what are you?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 13 points 4 months ago (2 children)

    A human with my own motivations and complex biological systems that including reasoning and the ability to think critically.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 4 months ago

    "Correlates"? As in: "It gives you the answer it best correlates with your prompts/context." Feels somewhat right both in the sense of AI as tensor-based word-select autocomplete and as a "lower-level" process than genuine thought, one which turns incongruent inputs ("I'm an AI" and "I just deleted prod+backup") into meaningless output ("The AI is sorry") that might look OK at a distance.

  • permalink
  • fedilink
  • source
  • parent