▲ 12 ▼ [AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone) submitted 1 day ago by Alvaro@lemmy.blahaj.zone to c/selfhosted@lemmy.world 39 comments fedilink hide all child comments What tools and projects do you use for your local LLM chats and agents? I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.
[–] wewbull@feddit.uk 3 points 1 day ago Pi - plain and simple - run inside firejail. lamma.cpp w/ vulkan backend That's it. permalink fedilink source