11
[AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone)
submitted 1 day ago by to c/selfhosted@lemmy.world
39 comments fedilink hide all child comments
 

What tools and projects do you use for your local LLM chats and agents?

I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 20 hours ago

Pi Coding Agent on the laptop, openwebui as a self hosted service.

I don't host LLMs myself. My best hardware has 16GB of RAM, I could run a 4B model or so, but what's the point? So I buy compute with ZDR turned on.

  • permalink
  • fedilink
  • source
    •