-5

Idea: Selfhosted Interface for LLMs (lemmy.blahaj.zone)

submitted 2 months ago by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Like SearchXNG but for chatbots.

Acts as a trusted inbetween that takes the hit on all the tracking for you and you need no account.

There would be a self-hosted server with a webinterface, where you can choose which of the popular chatbots or hosted open source models you want to ask.

The not free Accounts could be payed with donations maybe?

Basically like duck.ai but without a big company involved.

top 2 comments

sorted by: hot top new old

[-] [email protected] 6 points 2 months ago

https://github.com/open-webui/open-webui

[-] [email protected] 1 points 1 month ago

I was looking for something like this. The idea is:

Run an open model like LLAMA or Mistral on my home server
Access it from a client on my phone, saving my poor phone's processor and battery.

Does something like this exist?

this post was submitted on 21 May 2025

-5 points (27.3% liked)

Self-hosting

3532 readers

1 users here now

Hosting your own services. Preferably at home and on low-power or shared hardware.

Also check out:

founded 3 years ago

MODERATORS

[email protected]