299
Reddit has a new AI training deal to sell user content (www.theverge.com)
submitted 2 years ago by [M, B] to c/technology@lemmy.world
28 comments fedilink hide all child comments
 

Reddit has a new AI training deal to sell user content::Reddit has reportedly made a deal with an unnamed AI company to allow access to its platform’s content for the purposes of AI model training.

you are viewing a single comment's thread
view the rest of the comments
[–] 26 points 2 years ago (7 children)

I'd be very surprised if people weren't already scraping Reddit for this.

  • permalink
  • fedilink
  • source
  • hideshow 7 child comments
    •
  • [–] 20 points 2 years ago* (2 children)

    I mean, there's /r/SubSimulatorGPT2 that's been running for years... Although that one was at least hilarious to read because at that stage the AI was in the sweet spot of being simultaneously coherent while making total lapses in logic.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 2 years ago* (1 child)

    it's all but guaranteed. Reminds me of this Computerphile video: https://youtu.be/WO2X3oZEJOA?t=874 TL;DW: there were "glitch tokens" in GPT (and therefore ChatGPT) which undeniably came from Reddit usernames.

    Note, there's no proof that these reddit usernames were in the training data (and there's even reasons to assume that they weren't, watch the video for context) but there's no doubt that OpenAI already had scraped reddit data at some point prior to training, probably mixed in with all the rest of their text data. I see no reason to assume they completely removed all reddit text before training. The video suggest reasons and evidence that they removed certain subreddits, not all of reddit.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •