all 14 comments

sorted by: hot top controversial new old
[–] 71 points 6 months ago (2 children)

"Rogue AI" as if it's some sentient evil thing when its just a llm with too many permissions... This timeline is so dystopian, but simultaneously incredibly lame i hate it.

  • source
  • hideshow 2 child comments
  • [–] 14 points 6 months ago*

    It shows LLMs can do significant harm without the capabilities of an AGI.

    Overhyping LLMs and overinflating their capabilities makes things worse, as people are less skeptical of LLM output.

  • source
  • parent
  • [–] 32 points 6 months ago* (last edited 6 months ago) (4 children)

    According to Clayton, the AI agent involved didn’t take any technical action itself, beyond posting inaccurate technical advice, something a human could have also done.

    Producing innaccurate technical advice, with a confident tone, at scale.

    If that LLM were an employee it would get a formal blame, and then demoted or fired as it continues.

  • source
  • hideshow 4 child comments
  • [–] 15 points 6 months ago (2 children)

    That sounds sweetly naive. "Producing innaccurate technical advice, with a confident tone, at scale" sounds like the perfect credentials for a career in consultancy.

  • source
  • parent
  • hideshow 2 child comments
  • [+] 19 points 6 months ago* (last edited 2 weeks ago) (2 children)
  • [–] 16 points 6 months ago (2 children)

    "Flagrant security lapse caused an incident when software engineer uses inappropriate tool for the job."

  • source
  • hideshow 2 child comments