Chip fabbing allocations are limited and what chips for Ai datacenters takeup, the desktop GPUs don't get made. And what's left of it are desktop chips sold for workstation Ai models like the RTX 5090 and even RX 7900 XTX because they have more memory. Meanwhile they still sell 8GB cards to gamers when it hasn't been enough for a while. Whole situation is just absurd.

Still have limited wafers at the fabs. The chips going to datacenters could have been consumer stuff instead. Besides they (nVidia, Apple, AMD) are all fabricated at TSMC.

Local AI benefits from platforms with unified memory that can be expanded. Watch platforms based on AMD's Ryzen AI MAX 300 chip or whatever they call it take off. Frameworks you can config a machine with that chip to 128 GB RAM iirc. It's the main reason why I believe Apple's memory upgrades cost a ton so that it isn't a viable option financially for local AI applications.

I'm pretty sure the fabs making the chips for datacenter cards could be making more consumer grade cards but those are less profitable. And since fabs aren't infinite the price of datacenter cards is still going to affect consumer ones.

Funny enough, here’s a description of AI I wrote yesterday that I think you’ll relate to:

AI is the lazy colleague that will never get fired because their dad is the CTO. You’re forced to pair with them on a daily basis. You try to hand them menial tasks that they still manage to get completely wrong, while dear ol’ dad is gassing them up in every all-hands meeting.

Stable Diffusion does a lot already, for static pictures. I get good use out of Eleven for voice work, when I want something that isn't my own narration.

I'm really looking forward to all of these new AI features in DaVinci Resolve 20. These are actual useful features that would improve my workflow. I already made good use of the "Create Subtitles From Audio" feature to streamline subtitling.

Good AI tools are out there. They are just invisibility doing the work for people that pay attention while all of the billionaires make noise about LLMs that do almost nothing.

I compare it to CGI. The very best CGI are the effects you don't even notice. The worst CGI is when you try to employ it in every place that it's not designed for.

Not me personally, as AI can't really replicate my work (I'm a senior sound designer on a big game), but a few colleagues of mine have already begun reaping the workflow improvements of AI at their studio.