2
European, reputable inference providers with a large repertoire? (programming.dev)
submitted 1 day ago* by to c/aicoding@programming.dev
5 comments fedilink hide all child comments
 

Many companies now provide some kind of agentic tooling and expect its use. Some mandate which one, some are open. Most however, use US products and are sending all their data to Anslopic, Microslop, Goolag, ClosedAI, and so on. Not only that, they are expensive af. I've seen bills above 600€ per employee where management didn't even flinch.

There are "inference providers", but every single one on HuggingFace is a US company. There are also the model providers themselves but again, US or Chinese with the exception of Mistral in Europe.

To be able to convince management to use something else, it would have to be cheaper yet "powerful" (DeepSeek fits but is in China), have enough choice (it can't be a single model provider like Mistral, Anslopic, etc.), and be in Europe.

Does such a thing exist?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 day ago (1 child)

How about a cloud provider and then taking a open model to that? Also difficult to find, but it's better chance... Hetzner comes to mind. Then you may self-host ollama and some gateway to monitor token usage.

Even if it came to API key on a asian or american company, self host makes sense to me to relax on the lock in (e.g. Bifrost) and have some management dashboard. There's a growing ecosystem of self-hosted tools, the lates I saw was experientiallabs.ai that was aimed to save costs.

(6I'm on a similar track tho I am just a 1-man army with lended over pro plans (no apis) setting up omp.sh to combine and decouple tasks among providers and differentially sized models.)

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] [S] 1 point 20 hours ago

    How about a cloud provider and then taking a open model to that?

    That would require somebody managing that and there's no way my company would pay for that. From what I could find on Hetzner, it costs 0.4€/hour just for the instance. The rest will come on top.

    https://www.experientiallabs.ai/ seems like a self-hosted wrapper around other paid services. You'd need to get an Anslopic subscription, a Goolag subscription, and so on.

    I'm looking for an EU company like one of the companies on this list. DeepInfra, fal, basten, and so on. They show you a list of models they have a price, and all you have to do is sign up, whip out the credit card, copy paste the API URL into your harness (pi, opencode, claude code, whatever) and you're a hundreds lighter as a company but with no headache about running the entire thing yourself.

  • permalink
  • fedilink
  • source
  • parent