Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)

submitted 1 week ago* (last edited 1 week ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

top 2 comments

sorted by: hot top new old

[-] [email protected] 15 points 1 week ago

This is already a thing, there are a myriad of LLM chat interfaces where you can either connecting to models you are locally running or connect to APIs of providers. "Open WebUI", "librechat" and "Big-AGI" are web interfaces. On desktop you have things like jan.ai and a a lot more.

[-] [email protected] 13 points 1 week ago

Your goal is antithetical since even without tracking the LLM is still absorbing everything you say to it.

If you're concerned, just run a local LLM and skip the web service one.

this post was submitted on 21 May 2025

3 points (63.6% liked)

Free and Open Source Software

18780 readers

112 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]