218
How to explain Technical Debt to your Boss
(feddit.org)
Post funny things about programming here! (Or just rant about your favourite programming language.)
Sure, just need $3000 for an extra GPU with at least 24GB ram to load any reliable models. Tested Qwen 3 with my 3060 and it hallucinated a Legoland theme park next to a village with a population of 500 in the middle of nowhere.
I forget what the latest I ran the numbers on was, but $100K up front and $20K per year running costs seemed like it had a decent chance of being useful to our department of 10 software engineers, which isn't bad, but it's an LLM on par with 6 months ago's frontier models.
If I could get those prices for a local instance of Fable 5, I'd be pushing the paperwork to make it happen.