2
European, reputable inference providers with a large repertoire? (programming.dev)
submitted 1 day ago* by to c/aicoding@programming.dev
5 comments fedilink hide all child comments
 

Many companies now provide some kind of agentic tooling and expect its use. Some mandate which one, some are open. Most however, use US products and are sending all their data to Anslopic, Microslop, Goolag, ClosedAI, and so on. Not only that, they are expensive af. I've seen bills above 600€ per employee where management didn't even flinch.

There are "inference providers", but every single one on HuggingFace is a US company. There are also the model providers themselves but again, US or Chinese with the exception of Mistral in Europe.

To be able to convince management to use something else, it would have to be cheaper yet "powerful" (DeepSeek fits but is in China), have enough choice (it can't be a single model provider like Mistral, Anslopic, etc.), and be in Europe.

Does such a thing exist?

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 1 day ago

How about a cloud provider and then taking a open model to that?

That would require somebody managing that and there's no way my company would pay for that. From what I could find on Hetzner, it costs 0.4€/hour just for the instance. The rest will come on top.

https://www.experientiallabs.ai/ seems like a self-hosted wrapper around other paid services. You'd need to get an Anslopic subscription, a Goolag subscription, and so on.

I'm looking for an EU company like one of the companies on this list. DeepInfra, fal, basten, and so on. They show you a list of models they have a price, and all you have to do is sign up, whip out the credit card, copy paste the API URL into your harness (pi, opencode, claude code, whatever) and you're a hundreds lighter as a company but with no headache about running the entire thing yourself.

  • permalink
  • fedilink
  • source
  • parent