I picked the way in which an AI model (as the exist now) could most trivially produce a piece of novel (and deliberately trivial) information.

I wasn't worried about whether the credit could fairly be attributed to it. We're talking about whether they can produce information with which to grow their knowledge. Moral credit for the growth of their knowledge is outside the scope of the discussion.