LLM outputs are 100% deterministic.
If you enter the same prompt with the same seed you will get the same vector outputs.
Chatbots take those vector outputs and treat them as a distribution and select a random token. This isn't a property of the LLMs, it's a property of chatbots.