Use The New Means And The Old (lemmygrad.ml)

submitted 1 week ago by [email protected] to c/[email protected]

49 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] [email protected] 2 points 6 days ago

On another note Ollama is really shitty and they're trying to push their own API format, please consider using the one true community deriven gigachad Russian developed 'llama.cpp'. KoboldCPP even has a nice web UI for use.

permalink
fedilink
source
parent
hideshow 2 child comments

[-] [email protected] 2 points 6 days ago

oh thanks for the heads up, I've heard of llama.cpp, but never bothered looking into taking it for a spin.

permalink
fedilink
source
parent

this post was submitted on 09 Jul 2025

44 points (84.4% liked)

Memes

4354 readers

108 users here now

Good memes, bad memes, unite towards a united front.

founded 5 years ago

MODERATORS

[email protected]