12
[AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone)
submitted 1 day ago by to c/selfhosted@lemmy.world
39 comments fedilink hide all child comments
 

What tools and projects do you use for your local LLM chats and agents?

I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 6 hours ago (1 child)

Man, the world is so crazy right now I'm not that sure if you're joking or not hahaha

What about giving the "outiside consultants" their own animations and have them interacting among themselves?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 5 hours ago

    Not joking.

    TBH, the animations were a fun, early addition that were a PITA to get working properly for what's essentially a cosmetic indicator of state... and are just a waste of resources if I'm not at the computer running her client. Once I had her working consistently, I quickly developed a backlog of things I wanted to spend GPU time on and making more videos isn't one of them lol.

  • permalink
  • fedilink
  • source
  • parent