They would need to be trained for open ended creative tasks, which is just hard in the current reinforcement learning paradigm.

They still don't get it right all the time, they just stacked a few together to filter out the obviously wrong stuff.

I think they'll find infinite ways to fuck up. The guardrails will never be high enough, or strong enough.