Local models are meaningfully useful* for agentic work now. This is a realization I came to over the last day or so.

I wrote a lot of custom mods for a game that recently switched engines. The migration is going rather smooth for most people because of wise architectural choices from the dev early on, and because they prioritized backwards compatibility in the update. But there are still some rough edges, especially if you had your hooks deep into the engine.

I recently vibeforked Unbiased Bob's fork of Strata to make it compatible, easy to use and optimized for my OS and hardware (NixOS 5800x3d 64gb, 7900xtx 24gb). Sol 6.1 got it working with Qwen 3.8 Flash Next IQ3 XSS (~75GB) at roughly 46tps 164k ctx with enough headroom to launch a heavy browser along with a triple-A game set to low in 720p for testing when I need to (plus space for zram swap)

I set it up in deepseek harness, gave it a 14MB error log in the game's working directory, then went to sleep. I woke up and it had run for 3 hours. The game launched with only two errors, which it quickly fixed from the new, vastly smaller logfile.

It hammered down every issue, making changes across 30 separate mod repos. Practically a one-shot, and all the features worked as originally intended.

I left a local coding agent running completely on its own for three hours across multiple repos across a dozen auto-compactions with a log file and no ability for it to verify its work besides a compiler. And it produced meaningful results. I can't speak to the code quality, but it worked. This was completely unthinkable even just two years ago. Even one year ago, the cloud frontier wouldn't be able to do this on its own, and now a local model can, running on my consumer gaming hardware from one or two gens back.

“Huh... So... We're here now..." I said to myself, with a bit of stunned disbelief, wondering what the future one or two years from now might hold.

you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 35 minutes ago (1 child)

Yeah, however, imagine that those kids are ruining your industry. But let me guess. You’d be totally fine with that, right?

In fact, I am.

I'm a professional programmer. 20 years experience, it's where I earn my money, got a university degree and everything. And we're here in a thread about how not only are AI models good at programming, even small local models are good at programming. I use them myself, I give advice on how to use them, I ask advice on how to use them. I think they're really neat and look forward to using them more, and encourage everyone else to also use them.

Sure, some people have no idea what they're doing and they end up writing not very good software. My reaction to that is to try to explain to them what they did wrong and how they can get better. Or, if their not-very-good software is still perfectly good for whatever they're using it for, I give them a little thumbs up and say "good on you, just make sure you know what you've got there."

I’m here to say what needs to be said.

No, you're here to interject yourself into a conversation that was not at all about AI music to push your personal dislike of AI music and to insult people who don't share your view of AI music.

It doesn't need to be said. Certainly not here and now.

  • source
  • parent
  • hideshow 1 child comment