636
the latest Shai Hulud malware contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malware (indieweb.social)
submitted 3 months ago by to c/technology@lemmy.world
128 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 months ago (6 children)

It very much is. This is a well documented issue with the very design of these LLMs

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 2 points 3 months ago (3 children)

    And yet the LLMs that I use actually do distinguish, in my actual real life experience.

    So you're telling me the sky is orange while I'm literally looking outside the window and seeing that it is not.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 3 months ago

    You might have licked it getting them to ignore someone you didn't want, but they still take in both the prompt and the data as one input.

    And since these work like a black box, your experience doesn't mean much because you're not seeing the actual inner workings.

    I'm telling you the sky is blue, but you want to argue because there's a curtain in front of your window blocking it from your sight. But what's behind that curtain is well documented regardless of your experience.

  • permalink
  • fedilink
  • source
  • parent