Doesn't seem to be the case, some popular servers:

• Ollama written in Go
• llama.cpp C++

And then of course talking to these servers can be in any language that has a library for it or even just handles network requests, although Python is a nice choice. Possibly the process of training models is more heavy on the Python dependencies than inference is, haven't actually done anything with that though.