No, they’re hoarding them so you have to pay for cloud services they control from now on. With your little Fire tablet. No more pirating movies or political organizing for you, piggy

Buy it, destroy it. Just like buying bunch of old books, train their LLM's and burn it. Humanity has gone a long way to be that stupid.

Upgrade that to 3.8 as soon as your hardware allows (and your use case makes sense). 3.8 is quite a bit more rational.

A used 3090 is like 2-3k though, IF you can find one :| A month of claude is like 20 EUR. A month of opencode go is half that, but you get less usage.

There is a way. There was a post yesterday on exactly this, let me find it... https://lemmy.world/post/51283416

9060xt 16gb is the most cost effective new GPU, but if you're going used look for a V620 on eBay. It's a 6800xt chip but in server form factor GPU with 32GB vram. Can be a bit of a pain to set up but by far the most cost effective option IMO

For your hardware, the VRam is not enough to run 27b but, I’d recommend Qwen 3.5 9b for image / text to text.

And I’m planning to experiment with Qwen 3.8 9b for text to text.

4_k_m quantization is the sweet spot for performance and ram usage.

Also, I find Llama cpp is better than Ollama in terms of performance.