Intriguing. Should be interesting to compare this to Qwen3.8 (27B). I've been plenty impressed with Qwen's ability, but boy does it like to overthink things, even after getting it off the default xhigh reasoning, it'll take 20 minutes to plan something, thinking so much it'll have to compress its context multiple times to reach a single answer. The quality of the answer is great, but there has to be a middle ground.

We are releasing intermediate checkpoints, training data or detailed data-construction recipes

👀

Is this the first actually open source model?

36B-A4B!

Very interested in this

Their new attention mechanism sounds super interesting.

Can't wait for it to hit ollama so I can easily add it into my flow. I really need a better ollama alternative where I can easily download, manage, and run gguf locally and tie it in with opencode, zed, and open-webui