Congrats, you've discovered reductionism. The human brain also doesn't know things, as it's composed of electrical synapses made of molecules that obey the laws of physics and direct one's mouth to make words in response to signals that come from the ears.

Not saying LLMs don't know things, but your argument as to why they don't know things has no merit.