The problem is that we've had a culture of people who don't know things very well control the purse strings relevant to those things.

I mean that has been the case for a long time, AI may enhance the effect of it, but human stupidity is nothing new.

So we have executives who don't know their work or customers at all and just try to bullshit while their people frantically try to repair the damage the executive does to preserve their jobs. Then they see bullshit generating platforms and see a kindred spirit, and set a goal of replacing those dumb employees with a more "executive" like entity that also can generate reports and code directly. No talking back, no explaining that the request needs clarification, that the data doesn't support their decision, just a "yes, and..." result agreeing with whatever dumbass request they thought would be correct and simple.

Once again, yes men have also been a historic phenomenon, and yes AI might speed this up, but it is nothing new per se. 

Ai is a tool, not a perfect one, heck most of the time, barely functional, but it is a tool and in order to use it, you need to understand what it can do, and what it can't do. 

I think if you're aware of the environmental impact, learn how to use it responsibly and avoid many of it pitfalls, together with a critical mindset, it can be usable for some cases. 

And on top of that, the people who don’t know things very well generated lots of the material the LLMs were trained on in the first place.

Can’t really blame the models for realizing much of human knowledge is bullshit and acting accordingly.