this post was submitted on 26 Feb 2025
518 points (97.8% liked)
Programmer Humor
20800 readers
1435 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Not a developer. I just wonder about AI hallucinations come about. Is it the 'need' to complete the task requested at the cost of being wrong?
Full disclosure - my background is in operations (think IT) not AI research. So some of this might be wrong.
What's marketed as AI is something called a large language model. This distinction is important because AI implies intelligence - where as a LLM is something else. At a high level LLMs are using something called "tokens" to break apart natural language into elements that a machine can understand, and then recombining those tokens to "create" something new. When a LLM is creating output it does not know what it is saying - it knows what token statistically comes after the token(s) it has generated already.
So to answer your question. An AI can hallucinate because it does not know the answer - its using advanced math to know that the period goes at the end of the sentence. and not in the middle.