reallykindasorta comments on Stop Thinking of LLMs as Next-Token Predictors

[–] reallykindasorta@slrpnk.net 1 point 1 month ago (2 children)

Yeah and he basically argues that you shouldn’t see it as next-token even though he agrees that it is lol

parent

[–] m532@lemmygrad.ml 2 points 1 month ago

And a mouse is technically a blob of molecules. But does calling a mouse a blob of molecules explain why it moves away from cats?

permalink

fedilink

source

parent

[–] frisbird@lemmy.ml -1 points 1 month ago

But it's different because "it does it's own exploration of infinite space which is exactly like knowing how to win all chess positions through a brute force solution to the finite game space"

permalink

fedilink

source

parent