The Kit Walsh article purposefully handwaves around a couple of issues that could present larger issues as law suits in this arena continue.
-
He says that due to the size of training data and the model, only a byte of data per image could be stored in any compressed format, but this assumes all training data is treated equally. It's very possible certain image artifacts are compressed/stored in the weights more than other images.
-
These models don't produce exact copies. Beyond the Getty issue, nytimes recently released an article about a near duplicate - https://www.nytimes.com/interactive/2024/01/25/business/ai-image-generators-openai-microsoft-midjourney-copyright.html.
I think some of the points he makes are valid, but they're making a lot of assumptions about what is actually going on in these models which we either don't know for certain or have evidence to the contrary.
I didn't read Katherine's article so maybe there is something more there.