you are viewing a single comment's thread
view the rest of the comments
[–] 32 points 3 years ago* (last edited 3 years ago) (7 children)

That’s a fundamental misunderstanding of how diffusion models work. These models extract concepts and can effortlessly combine them to new images.

If it learns woman + crown = queen

and queen - woman + man = king

it is able to combine any such concept together

As Stability has noted. any model that has the concept of naked and the concept of child in it can be used like this. They tried to remove naked for Stable Diffusion 2 and nobody used it.

Nobody trained these models on CSAM and the problem is a dilemma in the same way a knife is a dilemma. We all know a malicious person can use a knife for murder, including of children Yet society has decided that knives sufficient other uses that we still allow their sale pretty much everywhere.

  • source
  • parent
  • hideshow 7 child comments
  • [–] -2 points 3 years ago* (last edited 2 years ago) (3 children)

    Editing this reply to say that I was in fact right and I did not have any fundamental misunderstanding of anything. And the database in question here is called LAIOn and contains 6 billions images scraped from the web, including CSAM images.

    Thanks for that. As I said, I'm not big into how AI works, so not surprised I got that wrong. The databases of everything that has come across the clear web are still there though and are available for use by people with access.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 5 points 3 years ago (2 children)

    What are you referring to by "the database of everything that has come across the clear web"?

  • source
  • parent
  • hideshow 2 child comments