LLMs Corrupt Your Documents When You Delegate: Our large-scale experiment with 19 LLMs reveals that […] even frontier models corrupt an average of 25% of document content by the end of long workflows (arxiv.org)

submitted 5 hours ago by cypherpunks@lemmy.ml to c/artificial_intel@lemmy.ml

2 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] jtrek@startrek.website 1 points 1 hour ago

That's not how humans work. We're lazy.

You ever use snapshot tests? They're garbage. They're garbage because people glance at a 300 line diff and go "that seems right", because a good chunk of the time it is. But some portion of the time, it's borked up.

Having it in git doesn't solve that problem.

this post was submitted on 09 May 2026

21 points (100.0% liked)

AI

6415 readers

37 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 5 years ago