this post was submitted on 22 Nov 2023
7 points (88.9% liked)

Self-Hosted Main

515 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS
[email protected]
7
Ollama - super easy to host local LLM (github.com)
submitted 11 months ago by [email protected] to c/[email protected]
6 comments fedilink hide all child comments
top 6 comments
sorted by: hot top controversial new old
[–] [email protected] 3 points 11 months ago

There’s also an unofficial web frontend https://github.com/ollama-webui/ollama-webui

Though I can’t get compose to use my gpu

[–] [email protected] 1 points 11 months ago

Thanks Ollama

[–] [email protected] 1 points 11 months ago

I'm thoroughly disappointed by the lack of Obama memes in this repo.

[–] [email protected] 1 points 11 months ago

Thanks for sharing this. Not an expert, so here goes my dumb questions. Can we potentially train these model with local data kinds of like Stable Diffusion checkpoints?

[–] [email protected] 1 points 11 months ago

Ollama works great with Big-AGI too, look it up on github.

[–] [email protected] 1 points 11 months ago

Ollama is pretty sweet, I'm self-hosting it using 3B models on an old X79 server. I created a neat terminal AI client that makes requests to it on the local network - called "Jeeves Assistant".