I wonder what the AI makers will choose to do:

• Train models on the full dataset, and have them come out trash because even a little AI-generated content poisons the training data

• Train models only on pre-2020 data, and have it be completely out of date on news and culture

• Train a markov model instead, because you don't need the cutting edge to generate "epic bacon narwhal le gentlesir"