637
OpenAI says dead teen violated TOS when he used ChatGPT to plan suicide
(arstechnica.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 27 Nov 2025
637 points (98.6% liked)
Not The Onion
20225 readers
1110 users here now
Welcome
We're not The Onion! Not affiliated with them in any way! Not operated by them in any way! All the news here is real!
The Rules
Posts must be:
- Links to news stories from...
- ...credible sources, with...
- ...their original headlines, that...
- ...would make people who see the headline think, “That has got to be a story from The Onion, America’s Finest News Source.”
Please also avoid duplicates.
Comments and post content must abide by the server rules for Lemmy.world and generally abstain from trollish, bigoted, or otherwise disruptive behavior that makes this community less fun for everyone.
And that’s basically it!
founded 2 years ago
MODERATORS
In the court document, it lays out how OpenAI developed the latest model to prioritize engagement. In this case, they had a system that was consistently flagging his conversations as high risk for harm, but it didn't have any safeguards to actually end the conversation like it does when requested to generate copyrighted material.
The complaint is ultimately saying that OpenAI should have implemented safeguards to stop the conversation when the system determined that it was high risk rather than allowing it to continue to give responses from the large language model.