So LLM’s are basically fancy auto correct. You type a phrase and it guesses what comes next, based on training and weights, etc.

Hallucinations happen when the guess is wrong. And then you iterate on the wrong guess. So the initial guess can be minor, it can guess “how can I drive a car” instead of “how can I drive a tractor”. Which on its own is a small deviation, but after looping on that wrong guess, the outcome is much different.

This is a high level view but I hope it makes sense.