280
Poisoned AI went rogue during training and couldn't be taught to behave again in 'legitimately scary' study (www.livescience.com)
submitted 2 years ago by [M, B] to c/technology@lemmy.world
54 comments fedilink hide all child comments
 

Poisoned AI went rogue during training and couldn't be taught to behave again in 'legitimately scary' study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 2 years ago

Programming is "just text". They doesn't mean that programming isn't incredibly powerful or that it can't be used to do dangerous things. Maybe the missing piece that you're unaware of is that LLMs are already very effective at programming and usage APIs. You don't even need to have an LLM that's good at programming to cause damage, it just needs access to APIs that can cause damage.

  • permalink
  • fedilink
  • source
  • parent