It still requires oversight and expertise

Perhaps some people who don't mind the ethics of gen AI work very hard to produce good work. But I believe that when you give people an easy, low-effort path, a great many of them will take it (regardless of the quality of the results). Training notwithstanding, a vast number of people cannot resist the lure of doing as little as possible.

It is terrible for a first draft if you're aiming for something that reads like a human being's actual thoughts. Don't let an LLM think for you and create the first draft of "your" thoughts. At most, if you absolutely must, use it as a spell checker. But write your words yourself.

No one wants to know what ChatGPT thinks. We might want to know what you think... But only if it's actually you doing the thinking.

It is great for a first draft

Only if the aim is towards mediocrity.

First draft of what? The AI* doesn't know what you're trying to make, so to use it, you first need to write a prompt to convey to it what you're trying to convey. If what you're trying to make takes the form of prose, there's your first draft already; there's nothing the AI can add other than padding and replacing your voice with a psychopath's. But to begin with, if you have the skill to turn a first draft into a final product, it's almost always going to be faster to just use that skill to create the first draft yourself instead of trying to convey to an AI what it's supposed to be like. If it isn't, it's something that's so easy to describe that there's either no value in making it or those few words are already the perfect way to convey it.

Also, this just completely undermines the whole thing:

It still requires oversight and expertise.

The sole virtue AI arguably has, is its accessibility; anyone who can read and write a supported natural language, can make use of it. But the moment it starts requiring expertise, that accessibility becomes worthless. To anyone who is even somewhat serious about what they're trying to do, that natural language interface just offers far too little control for their purposes.

*) For the purposes of this comment, "AI" refers to the kinds of natural language-driven generative AI heavily marketed by companies like Microsoft, not the general concept of artificial intelligence or even the underlying technology of those products.

Attention driven economy. All enterprises now behave like they had a field week at used cars salesmen retreat. You can't sell unless the value proposition is grotesquely inflated.