you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 11 hours ago (1 child)

Just a reminder to people that AI generated images need other non-AI images to be trained on. If someone is making AI CSAM, it's likely that they are using real CSAM to create it.

  • source
  • hideshow 2 child comments
  • [–] 13 points 11 hours ago (1 child)

    Eh, maybe, but maybe not.

    You could ask the AI for "a unicorn on a unicycle" and it doesn't need to have been trained on images of unicorns on unicycles in order to produce that. As long as it knows what a unicorn looks like and what a unicycle looks like, it can combine the two.

    Likewise, it's possible that it may be able to generate AI child porn without any actual child porn in its training dataset, but if it knows what children look like and what nudity looks like, then it could figure out what nude children look like.


    Now, none of this is to defend these AI companies. Fuck them for a thousand different reasons -- generating child porn images is just one of many reasons they're terrible. They should (at least) put better guardrails in place to prevent their AI bots from generating child porn images.

    But I do think it's important to be accurate and not go into it with misconceptions. And just because an image generator is capable of generating something doesn't mean it was trained on that thing.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 10 hours ago

    Likewise, it's possible that it may be able to generate AI child porn without any actual child porn in its training dataset, but if it knows what children look like and what nudity looks like, then it could figure out what nude children look like.

    This is true and it's what happened to OpenAI, there's a section in Karen Hao's Empire of AI about it. Remember, these companies (under) paid Kenyan workers and gave them PTSD to make sure CSAM and other undesirable content wasn't in their training set.

  • source
  • parent