Linux tips (thelemmy.club)
submitted 3 weeks ago* by to c/linuxmemes@lemmy.world
 
Linux tips
you are viewing a single comment's thread
view the rest of the comments
[โ€“] 2 points 3 weeks ago* (2 children)

Just Qwen3.8-27B. That little model is surprisingly smart.

NixOS also gives you the ability to roll back to previous config versions. I have not needed to do that (yet), but it reduces some risk.

  • source
  • parent
  • hideshow 2 child comments
  • [โ€“] 3 points 3 weeks ago (1 child)

    โ€œJustโ€ and a 27B model donโ€™t exactly belong in the same sentence if you ask my wallet. ๐Ÿ’ธ

  • source
  • parent
  • hideshow 1 child comment
  • [โ€“] 2 points 3 weeks ago

    Yeahhh sorry ๐Ÿ˜•

    I was fortunate to have bought my graphics card almost a year ago, and for a nice discount (a Black Friday sale, IIRC). I'd love to buy another, but they now cost >2x the price I paid.

    FWIW, you can probably run it on CPU if you have enough RAM. I assume it will be really slow though.

    Might also be worth trying Qwen3.6 35B-A3B. It's not as "smart" as Qwen3.8 27B, but can be much faster on limited resources.

  • source
  • parent