Recently made a post about the 35b MOE. Now the dense 27b variant has been released.


you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 4 months ago (1 child)

I can run models locally super easy in the CLI with a tool called ollama

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 4 months ago (1 child)

    Cool I’ve heard of it but I know there are a lot of variable. What model and size are you running with what hardware?

  • source
  • parent
  • hideshow 2 child comments