76
Sarah Silverman is suing OpenAI and Meta for copyright infringement (www.theverge.com)
submitted 3 years ago by to c/tech@kbin.social
42 comments fedilink hide all child comments
 

Comedian and author Sarah Silverman, as well as authors Christopher Golden and Richard Kadrey — are suing OpenAI and Meta each in a US District Court over dual claims of copyright infringement.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 years ago (1 child)

It’s difficult to tell to what extent books are encoded into the model. The data might be there in some abstract form or another.

During training it is kind of instructed to plagiarize the text it’s given. The instruction is basically “guess the next word of this unfinished excerpt”. It probably won’t memorize all input it’s given, but there’s a nonzero chance it manages to memorize some significant excerpts.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 years ago (1 child)

    It’s difficult to tell to what extent books are encoded into the model. The data might be there in some abstract form or another.

    This is a court case so the accusers are going to have to prove it.

    The evidence provided is that ChatGPT can produce two-page summaries of the books. The summaries are of unknown accuracy, I haven't read the books myself so I have no idea how much of those summaries are hallucinations. This is very weak.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago (1 child)

    They have to prove it but if they case gets far enough they will have the right to ask for discovery and they can see for themselves what was included. Thats why it might just settle quietly to avoid discovery.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 years ago

    The important question is not what was in the training data. The important question is what is in the model. The training data is not magically compressed into the model like some kind of physics-defying ultra-Zip, the model does not contain a copy of the training data.

    There are open-source language models out there, you can experiment with training them. Unless you massively over-fit it on a specific source document (an error that real AI training procedures do everything they can to avoid) you won't be able to extract the source documents from the resulting model.

  • permalink
  • fedilink
  • source
  • parent