NOBODY WANTS THIS SHIT!!!
That's a popular take, especially around here, but AI does have some pretty nice use cases; just not as many as the TechBros would have you believe.
Here's some examples I've personally seen in the last 14 days:
- It's good at transcribing meetings, including picking out who is talking, backing into an agenda, and highlighting action items.
- It's darn good at writing even moderately complex scripts in any of the common languages. (Powershell, Python, R, etc)
- In the right hands (fingers?) it's getting increasingly good at finding and exploiting security flaws.
- It's amazing at slicing and dicing data if the person using it knows what they're doing.
Does all of the "Agentic" Woo Woo shit work? No, it absolutely doesn't but it is clearly getting better as time goes on.
IMO this whole AI thing has some very strong parallels to the early '80s computer industry. Right now it often requires specialist knowledge for good results which makes it clunky to use, it is somewhat slow, there's very little interoperability, and it requires enormous amounts of power. Hell even this "over buying hardware" schtick fits right in, this happened with SRAM and then several times with DRAM as the industry matured.
However the industry is also making progress at almost insane speed; not only is the output getting demonstrably better but the negatives are being addressed. In the past 30 days I've seen prototype ASIC-esque hardware that works in a standard desktop PC and processes nearly 10,000 tokens a second with local processing.
The only reason you're not seeing that kind of kit in the market yet is because the models are still changing too much and no one wants to commit hundreds of millions to making cards that would be outdated before they could be shipped. We're probably only 18-24 months away though.
I've also seen 10x improvements in memory usage (TurboQuant) and literally dozens of little tweaks and tricks to reduce footprint and speed processing. Just like what was going on in the PC industry in the '80s and '90s.
So sure, Fuck AI (mostly) as it exists today but it won't be long before it's as ubiquitous as tablets and smartphones.