Recently made a post about the 35b MOE. Now the dense 27b variant has been released.


you are viewing a single comment's thread
view the rest of the comments
[+] 5 points 4 months ago* (last edited 4 months ago) (3 children)
  • [–] 2 points 4 months ago (2 children)

    Thanks! I’m experimenting with my laptop with 16GB RAM and no GPU/VRAM. I installed llama.cpp and am testing Gemma 7b Q5 but it’s not answering prompts correctly. It’s analyzing the prompt and not answering the question, or it gives me a poem haha. Trying to figure it out.

    Any lightweight model you recommend for just chat experimenting for now? Can they connect to the internet?

  • source
  • parent
  • hideshow 2 child comments