"You are right, I made a mistake. Here is a better answer." Continues to give wrong answers.

To be fair, the AI's not wrong. It's probably better, but just a teeny tiny bit so.

Honestly, AI is like a genie - whatever you come up with he'll just butcher and misinterpret so you start questioning both your own sanity and the semantics of language. Good thing these genies have no wish limit, but bad thing that they murder rainforests while generating their non-sequitur replies.