I feel like a really intelligent AI would recognize the context of the text it gets.
Like, if you or I heard someone saying a bunch of numbers we’d know to switch into math mode and start mathing.
But these things just dawdle along and start repeating nursery rhymes or whatever because they’re not smart enough to know what they’re doing.