636
the latest Shai Hulud malware contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malware (indieweb.social)
submitted 3 months ago by to c/technology@lemmy.world
128 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 3 months ago

They can be trained to understand the distinction.

No it can't because of how LLMs work. All "safety" built on top of models now are just band-aids and bubble gum stuck in strategic areas hoping that cases get caught.

  • permalink
  • fedilink
  • source
  • parent