Pretty safe? I am sorry but if it is your life on the line or a loved one pretty safe is just not going to cut it. When the AI decides your dying grandmother isn't priority because of a reason no one can explain or audit what them.This is a huge safety issue than you hand wave away because you are apparently enamored with AI.

I am trying to keep an open mind but replacing human thinking in emergency situations is not a reasonable application. You want a LLM model to triage your medical care with an unproven model that can and does make serious mistakes?

https://www.foley.com/p/102ixtc/stanford-study-finds-high-percentage-of-errors-using-large-language-models-in-leg/

This is not speculation. These companies are selling snake oil at this point and you act as their carnival barker. I do think that decades in the future these systems will be ready for these challenges, but I am not insane enough to believe this roll out is anything other than a cash grab at this point.

I find your statement that humans don't like giving up control very disturbing. We obviously do give up control for routine low level things like GPS everyday. This is not what your are alluding to though. You are advocating for giving up a higher level of control to an algorithm that can't be held accountable.

Maybe you are ready for a world of half baked customer agents, managers, counselors, architects, artists, doctors, teachers, judges, emergency dispatchers, etc but I am not. Ceding our control to a corporatocracy of profit driven yes men is not going to end well.