435
Google Researchers’ Attack Prompts ChatGPT to Reveal Its Training Data (www.404media.co)
submitted 2 years ago by to c/technology@lemmy.world
96 comments fedilink hide all child comments
 

ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 2 years ago (5 children)

You remember some dialogue from your favorite movie. Does this mean your neurons store copyrighted work?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 5 points 2 years ago* (3 children)

    Yes.

    Just because they're in a neural network and not ASCII or unicode doesn't mean they're not stored. It's even more apt a concept since apparently those works can be retrieved fairly easily, even if the references to them are hard to isolate. It seems ChatGPT is storing eidetic copies of data, which would imply what other people have said in this thread, that it is overfitting itself to the data and not learning truly generalisable language.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 2 years ago (2 children)

    The claim is that it contains entire copies of the book. It does not. AI memory is like our memory, we do not remember books word to word.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 2 years ago* (last edited 2 years ago) (1 child)

    They are spitting out, as in the quote above, "verbatim text", as in, word for word. That is copyrightable.

    And that's not what you said. You said it has no memory. That's clearly wrong.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •