Recently made a post about the 35b MOE. Now the dense 27b variant has been released.


you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 months ago* (4 children)

Koboldcpp is an easy way to get into running local llm:s they have executables for linux, mac, windows on their github and a simple gui to load a model

  • source
  • parent
  • hideshow 4 child comments