Yeah, I wouldn’t use it for coding. It’s a bit dumb unfortunately.
Looping was a problem after reaching a certain context window size. The llama.cpp flags - -flash-attn on and looping penalties helped.
I‘m not a coder, so I don’t know exactly. It is able to code, but I would say somebody with experience should guide it and have an eye on the results.
Have you tried qwen3.5-9b? It’s pretty solid for its size.
I don’t host it exactly, just use it when I don’t use my graphics card for gaming. I run Qwen3.6-35b on my 16gb vram RX 9700 xt with 34t/s. I use it as an IT advisor, admin and Linux teacher for my cachyOS gaming PC.
To the left ist Superman, considered as an unstoppable force of good.
To the right is Homelander, similar powers but a fascist, mentally ill person created by a corrupt Mega-Corporation.
To be fair, humans anthropomorphising everything, of course they do that with software that can fucking talk to them.
Bullshit. They planned to conquer Kiev in 3 days. Here we are almost 4 years later. It’s surprising how weak they are.
Confidence is a huge deal and very important. Now just talk like a confident you, not like Donald Trump.
What’s better than to do some journaling on the balcony on a nice summer evening?
Shot with my new (to me) Canon A1.
Make a comment saying „Luigi is good“ or something like that, that should get rid of your Reddit account.
I‘m german and I watch in real time how a fascist Gouvernement is taking over the US.
Sometimes I feel like I take crazy pills, when a friend of mine assures me that Donald Trump is just a business man who wants to help the country. Or when a good friend of mine who I considered sane and intelligent until this moment sends me a link to a J. D. Vance interview and tells me what a very smart guy this is.
It’s infuriating. And lonely. I think every American against this should be allowed to speak openly and participate. We have to work together, or we have lost already.
Yeah, a higher quant would be nice, I actually try not to go below Q5, but you can domino’s so much with 16GB of VRAM and the ddr4 system RAM.
But I must say I‘m pretty impressed by Qwen3.6-35b, not only from its capabilities but also from hardware requirements. MoE for the win I guess.
RWKV sounds interesting, have to look into it, thanks!