Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)

submitted 1 week ago* (last edited 1 week ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

you are viewing a single comment's thread
view the rest of the comments

[-] [email protected] 15 points 1 week ago

This is already a thing, there are a myriad of LLM chat interfaces where you can either connecting to models you are locally running or connect to APIs of providers. "Open WebUI", "librechat" and "Big-AGI" are web interfaces. On desktop you have things like jan.ai and a a lot more.

this post was submitted on 21 May 2025

4 points (66.7% liked)

Free and Open Source Software

18796 readers

89 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]