Nah, and it isn't what LLMs are doing now

LLMs just act on tokens and those are their limit in resolution.
That's why they're so bad when it comes to rhyming or counting letters.

They're not reasoning. And there is a difference between reasoning and giving it the statistical most probable next token - which doesn't have a meaning whatsoever