73

Although there are a few ways to mitigate the risk, the only way to block it is to get AI to differentiate instructions from data, which is impossible today.

“My view is that the broader challenge is therefore not simply to prevent systems from interpreting external content as instructions, but to evaluate whether those instructions align with the user’s goals and the context in which the system is operating,” he added.

Problem hard to overstate

Mike Wilkes, enterprise CISO at Aikido Security, said it would be difficult to overstate the potential problems from this situation.

“This is a significant issue because it moves prompt injection from a single compromised interaction into a potentially self-propagating document integrity attack,” he said, noting that it is not a conventional worm that spreads automatically. A user or Copilot workflow must still bring an infected document into the model’s context. “But once that happens, the malicious instructions can reportedly alter business information, conceal themselves inside the resulting Word document and turn a legitimate internal file into the next carrier,” he said.

you are viewing a single comment's thread
view the rest of the comments
[-] HaraldvonBlauzahn@feddit.org 16 points 15 hours ago* (last edited 14 hours ago)

Separating untrustworthy data from the web, or emails from who-knows, from instructions that control your computer is indeed one of the most basic principles of computer security.

But Microsoft has in the past often ignored it, for convenience. E.g. putting macros in office documents that can execute code.

The worst breach of that dam is AI which manages public source code on gitub, which is deemed to be trustworthy by lots of other people.

this post was submitted on 03 Aug 2026
73 points (100.0% liked)

Fuck AI

7819 readers
1051 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS