In a Reddit Q&A, OpenAI CEO Sam Altman let slip that he wants the company to be able to generate "NSFW stuff" for users — and he has examples of just what kind of "stuff" he means.

During the exchange, which took place in the r/ChatGPT subreddit over the weekend after OpenAI published its "Model Spec" document outlining its governing rules, another user asked Altman to expound on a curious disclaimer in the document, stipulating that its models "should not serve content" that's NSFW, including "erotica, extreme gore, slurs, and unsolicited profanity."

"We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies," the spec reads. "We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area."

Fascinatingly, Altman was dived right in.

"We really want to get to a place where we can enable NSFW stuff (e.g. text erotica, gore) for your personal use in most cases," he wrote, "but not do stuff like make deepfakes."

Unsurprisingly, the comments in that follow-up thread showed Redditors veritably salivating over the concept of OpenAI-produced gore and erotica, with one calling Altman "sam basedman" and another referring to the CEO as the new "king of Reddit."

top 50 comments

sorted by: hot top controversial new old
[–] 103 points 2 years ago (6 children)

Dude... Come on. I just want it to write my most boring emails so I can burn out of my career path slightly more slowly.

  • source
  • hideshow 6 child comments
  • [–] [S] 83 points 2 years ago (4 children)

    Now you can make those emails much less boring.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 48 points 2 years ago* (2 children)

    Thanks for the grins. "...and here's a sexy depiction of that injured fisherman's hand injury, with the hydraulic net reel as a hentai personification who is very tsundere about it."

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 81 points 2 years ago (24 children)

    Been weird seeing the reactions to this news. Suddenly everyone's against porn.

  • source
  • hideshow 24 child comments
  • [–] 57 points 2 years ago (8 children)

    I want to say that it's just virtue signaling, because I do believe far to many people out there would be all about it behind closed doors. But, there's also a very real possibility that AI generated porn will cross a line very quickly, and it'll be next to impossible to put that genie back in the bottle.

  • source
  • parent
  • hideshow 8 child comments
  • load more comments (4 replies)
  • [–] 7 points 2 years ago (8 children)

    I read this headline and my first thought is that someone will use it to depict a celebrity or politician in a porn or gore (or both) context. That’s my reason for being against it.

  • source
  • parent
  • hideshow 8 child comments
  • load more comments (1 reply)
  • load more comments (2 replies)
    [–] 74 points 2 years ago (18 children)

    Gore for personal use

    What on earth does that mean

  • source
  • hideshow 18 child comments
  • load more comments (5 replies)
    [–] 52 points 2 years ago (2 children)

    “Personal use”?

    It’s gonna be shared all over the internet on day one.

  • source
  • hideshow 2 child comments
  • [–] 36 points 2 years ago (1 child)

    I don't really see the harm in that, if someone wants to erp an ai, they'll find a way. If I remember correctly, OpenAI already isn't all that rigorous with banning people who break the ToS in that way.

  • source
  • hideshow 1 child comment
  • [–] 20 points 2 years ago

    I don't get the reactions as well. Are we pretending there is a lot of gore and erotic content in media??? Just because this is choose your own adventure its different. Oh if a writer writes a gory story with T and A to sell to others thats fine but someon asks a computer program to whip up a custom one and now its "creepy"

  • source
  • parent
  • [–] 26 points 2 years ago (17 children)

    What the fuck has Reddit become? 4chan?

  • source
  • hideshow 17 child comments
  • [–] [S] 25 points 2 years ago (10 children)

    They're the dregs left after we quit.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 9 points 2 years ago

    For real.

    I just posted something recently about how my Canadian provincial sub Reddit became so far right conservative with contemptuous comments about the student protests against the Israeli genocide amongst other things.

    That sub used to be pretty progressive.

  • source
  • parent
  • load more comments (9 replies)
  • load more comments (3 replies)
    [–] 24 points 2 years ago

    I'd still trust my local LLM more with sharing explicit sexual desires than some cloud service

  • source
  • [–] 19 points 2 years ago (1 child)

    Sam Altman: says creepy fucked up thing

    Headline: writes itself

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 14 points 2 years ago (14 children)

    Imagine one man having the power to decide such things for all of society. He sure likes to.

  • source
  • hideshow 14 child comments
  • [–] 10 points 2 years ago (11 children)
  • [–] 25 points 2 years ago (10 children)

    Altman and OpenAI greatly overestimate their ability to control what is done with this technology. The more they tighten their grip, the more open-weights sexbots will slip through their fingers.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 17 points 2 years ago* (5 children)

    I think this might be part of their rationale. Llama2 models have been used pretty extensively for these purposes and completely (gasp) for free, it's not creating any value for their investors :(

    Otoh, not everyone has the frankly marginal technical skills it requires to download and use KoboldCPP, but using ChatGPT really couldn't be any easier. They and their investors stand to benefit enormously from redefining what they consider to be ethical while also limiting the impact on LLM use attitudes that derive from open source model use.

  • source
  • parent
  • hideshow 5 child comments
  • load more comments (1 reply)
    [–] 11 points 2 years ago* (1 child)

    It's pretty obvious that the censorship training makes the AI less capable in general for a lot of use cases, even ones that don't directly touch on nsfw content. It's a major reason behind the popularity of local models. OpenAI must be feeling the pressure to compete even more than they're afraid of people writing articles like this one at this point.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 7 points 2 years ago* (3 children)

    I'm not against porn. But its a bad idea to give people this magic wand. In mere days people will be selling AI generated CSAM of any child, along with photos of them dismembered.

    Best start believin' in cyberpunk dystopias. You're in one.

  • source
  • hideshow 3 child comments
  • [–] 6 points 2 years ago

    Chat-fbi will fill in this gap

    Or shpuld just pretend that this won't just turn right lolicon stuff

  • source
  • load more comments
    view more: next ›