you are viewing a single comment's thread
view the rest of the comments
[–] [S] 2 points 2 weeks ago

I'm downloading the full weights currently. Will give it a try on my Framework Desktop when I can. I expect that I will need a newer version of llama.cpp given the new architecture -- there are already pull requests pending though... (e.g. https://github.com/ggml-org/llama.cpp/pull/27742)

  • source
  • parent