Technology

"Hallucinations" is the wrong word. To the LLM there's no difference between reality and "hallucinations", because it has no concept of reality or what's true and false. All it knows it what word maybe should come next. The "hallucination" only exists in the mind of the reader. The LLM did exactly what it was supposed to.

This sounds like a great movie.

AI sends police after him because of things he wrote. Writer is on the run, trying to clear his name the entire time. Somehow gets to broadcast the source of the articles to the world to clear his name. Plot twist ending is that he was indeed the perpetrator behind all the crimes.

The problem is not the AI. The problem is the huge numbers of morons who deploy AI without proper verfication and control.

Oh, this would be funny if people en masse were smart enough to understand the problems with generative ai. But, because there are people out there like that one dude threatening to sue Mutahar (quoted as saying "ChatGPT understands the law"), this has to be a problem.

Copilot’s results asserted that Bernklau was an escapee from a psychiatric institution, a convicted child abuser, and a conman preying on widowers.

Stephen King is going to be in big trouble if these AI thingies notice him.

"This guys name keeps showing up all over this case file" "Thats because he's the victim!"

why did it? because it's intrinsic to how it works. This is not a solvable problem.

The AI did not “decide” anything. It has no will. And no understanding of the consequences of any particular “decision”. But I guess “probabilistic model produces erroneous output” wouldn’t get as many views. The same point could still be made about not placing too much trust on the output of such models. Let’s stop supporting this weird anthropomorphizing of LLMs. In fact we should probably become much more discerning in using the term “AI”, because it alludes to a general intelligence akin to human intelligence with all the paraphernalia of humanity: consciousness, will, emotions, morality, sociality, duplicity, etc.

It’s frustrating that the article deals treats the problem like the mistake was including Martin’s name in the data set, and muses that that part isn’t fixable.

Martin’s name is a natural feature of the data set, but when they should be taking about fixing the AI model to stop hallucinations or allow humans to correct them, it seems the only fix is to censor the incorrect AI response, which gives the implication that it was saying something true but salacious.

Most of these problems would go away if AI vendors exposed the reasoning chain instead of treating their bugs as trade secrets.

And yet here we’re are, praising this garbage for its ability to perform simple tasks and take jobs from artists and entertainers.