29
SOTA LLMs via API - EU hosted - What do you use?
(thelemmy.club)
Welcome to BuyFromEU - A community dedicated to supporting European-made goods and services!
Feel free to post, comment and vote, be excellent to each other and follow the rules.
We also invite you to subscribe to:
Logo generated with mistral le chat Banner by Christian Lue on unsplash.com
There's Mistral AI in France. And Microsoft offers the OpenAI/ChatGPT models running in EU datacenters as part of Azure.
And if you're willing to set it up yourself, you can always rent a cloud server with some beefy GPUs and run arbitrary workloads on it. Your favourite AI models, games or whatever you like. OVH or RunPod.io for example have Linux servers with GPU access.
Sadly Mistral's models are somewhat behind at the moment from the benchmarks I've been looking at. But yeah that would probably be the most european solution.
Microsoft hosting in EU datacenters doesn't help with Microsoft being a US corporation. Therefor they need to hand data even from EU servers to US government by law (CLOUD Act). As far as I know they don't even claim differently.
As for now I still avoid setting it up myself, because it is just much more expensive if you don't run very high loads. The per token price for occasional or low volume load is just better using API services.
Hmmh. I think you already found the well-known services. I found one more: regolo.ai from Seeweb?!
But I'm not aware of anything that properly fits what you're asking for.
I'll mostly tinker around with RunPod instances. But that's not what you're looking for. If you find something good and cheap (and prepaid) I might have some use-cases for it as well. Like connect my Home Assistant voice assistant to it.