-5
submitted 5 days ago by [email protected] to c/[email protected]

Hey everyone, I’ve been working on something in my free time — a wrapper that lets you use open AI models (like Mistral, LLaMA, etc.) in a clean interface. The longer-term idea is to make it easier to run larger models — 70B+, fine-tuned variants, or your own — without needing your own GPU cluster. Still very much a side project — I’m building this for fun, learning as I go, and curious if it’s useful to anyone else. Link’s here if you want to try it: https://umbraai.xyz/

top 1 comments
sorted by: hot top new old
[-] [email protected] 7 points 5 days ago

It's just an OpenWebUI instance? What have you added to/changed about it?

this post was submitted on 05 Jul 2025
-5 points (33.3% liked)

Programming

21494 readers
163 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]



founded 2 years ago
MODERATORS