you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 10 months ago*

OpenLlama. Alpaca.

Run a local friend model, today!

I... actually futzed around with this just to see if it would work, and... yeah, there actually are models that will run on a Steam Deck, with Bazzite.

EDIT: Got my angry spitting long necked quadrupeds mixed up.

Alpaca is a flatpak, literally could not be easier to set up a local LLM.

  • source
  • parent