I hate to tell you this, but the code running most critical systems out there is already completely fucked.
Most people assume that just because software developer has been a degree for the last few decades that everything has been rewritten by professionals, but there are a crazy number of systems still running 3-5 decades from when they were first created. A vast majority of this shit was written before "programmer" was a profession or a degree. So, everything was written by some person who had a job doing something that had nothing to do with computers, but either dicked with computers as a hobby, or was forced into it because no one else wanted to do it.
People point at Y2K as the point when everything had to be rewritten and replaced, but most Y2k solutions just involved patching the software and nothing else. All that shit is still out there and running.
And let's be frank, every profession has people that are just aren't capable but seem to stay in it no matter what. For every bad waiter you have ever dealt with, there is a developer who is just as shit at their job.
And that is on top of companies who just don't give a fuck and who knowingly put shit software out because it is more profitable to cheat people than provide what they promised.

So, don't worry about AI causing some great collapse. We were already well on our way there without AI.

That's why I mentioned that I want real devs looking at the code.