9
[AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone)
submitted 23 hours ago by to c/selfhosted@lemmy.world
36 comments fedilink hide all child comments
 

What tools and projects do you use for your local LLM chats and agents?

I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 18 hours ago

Currently, I'm using Hermes and OpenCode mostly, backed by Ollama running a couple of different models. Usually I'm running the Gemma4 or Gwen3.5 models.

Memory management is done through Obsidian as every harness seems to have really good skills for it.

  • permalink
  • fedilink
  • source
    •