407
submitted 23 hours ago by tonytins@pawb.social to c/fuck_ai@lemmy.world

Fiction written by artificial intelligence is easy to detect because it struggles with complex story structure and tends to moralize in clunky ways, according to a preprint study from researchers at University of Maryland, College Park and Google DeepMind. They found that AI fiction has tells that go beyond stereotypical overuse of em-dashes and other obvious AI tropes and have more to do with the formulaic nature of the text itself.

“AI stories over-explain themes and favor tidy, single-track plots while human stories frame protagonists’ choices as more morally ambiguous and have increased temporal complexity,” the study, which looked at more than 50,000 AI-generated short stories, found. “Claude produces notably flat event escalation, GPT over-indexes on dream sequences, and Gemini defaults to external character description. We find that AI-generated stories cluster in a shared region of narrative space, while human-authored stories exhibit greater diversity. More broadly, these results suggest that differences in underlying narrative construction, not just writing style, can be used to separate human-written original works from AI-generated fiction.”

Basically, AI-generated fiction sucks and at the moment is easy to detect. The typical method of detection involves looking for stylistic markers such as an abundance of em-dashes, the overuse of the word “delve,” or an obsession with goblins, but this project tried something different. “The idea for this project came because we are hoping to eventually move past plain text detection, into some sort of space where we can separate human ideas from AI-generated ideas,” Jenna Russell, a University of Maryland researcher and one of the study’s authors, told 404 Media. Russell is also an intern at the AI-detection company Pangram.

top 50 comments
sorted by: hot top new old
[-] FellowEnt@sh.itjust.works 8 points 6 hours ago

I was recently talking to an independent bookshop owner, looking at some of the submissions for self-published books. It was depressing as fuck. An absolute slop fest. The 'illustrated' childrens books were by far the worst offenders.

[-] MartianRecon@lemmus.org 13 points 7 hours ago

LMMs are just mediocrity machines.

You input one great book, and 25 dogshit fanfictions, you're not going to output a great book.

It's like teaching someone how to cook Chateaubriand, but also 19 recipes for hot dogs, and then expecting them to make braised lamb or some shit.

[-] Noja@sopuli.xyz 6 points 7 hours ago

You are wrong, even a LLM fed with 26 great books couldn't write a good one.

[-] MartianRecon@lemmus.org 4 points 6 hours ago

Oh, I fully fucking agree.

I'm just putting this in 'crayon eater' terms for them to try and understand.

[-] nullspace@lemmy.world 5 points 7 hours ago

AI stories give me whiplash with how borderline personality disorder the characters seem after any significant length.

[-] UnrepententProcrastinator@lemmy.ca 15 points 11 hours ago

I mean yeah they mostly learned from fanfic authors.

[-] dumnezero@piefed.social 7 points 10 hours ago

peak mediocrity

[-] umbraroze@slrpnk.net 17 points 13 hours ago

I remember the stuff they added to Duolingo after the leadership went "AI first".

Duolingo has these story exercises. Old stories were all kind of fun and distinctive, and the characters are fun and memorable. Then they got the bright idea to AI generate more stories.

"Oh, don't worry, the new content will all be reviewed by humans", they said.

Were they?

The new stories were... I don't even remember any more. Best I can describe them is "there's stuff and it happens and the characters are just kinda there". It went in one ear, out of the other. I fucking can't. I don't think I was learning stuff from that.

And these were tiny stories, like couple of hundred words tops. Anyone uses LLMs to write novels is out of their rocker.

[-] Lumidaub@feddit.org 7 points 11 hours ago

there's stuff and it happens and the characters are just kinda there

You're welcome to ignore this, but I feel I have to point out, not to you, but the universe in general (and just coincidentally as a reply to your comment), how well this describes almost everything about the most recent two episodes of a beloved TV series featuring a blue box that travels in time and space (which I like the usual amount). I'm going to go cry now. 🟦

[-] FearMeAndDecay@literature.cafe 4 points 10 hours ago

You’re right and you should say it and I’m also going to cry now

[-] Witchfire@lemmy.world 2 points 9 hours ago

Ugh you're right about Duolingo stories. They're so formulaic nowadays. Half of them are about Oscar brown-nosing some journalist.

[-] Mrkawfee@lemmy.world 6 points 11 hours ago

Lots of fiction is mediocre so this tracks.

[-] Luisp@lemmy.dbzer0.com 4 points 11 hours ago

Also the human part, the general idea of what the story is about is unoriginal because of the AI user himself

[-] trem@lemmy.blahaj.zone 40 points 20 hours ago

Claude produces notably flat event escalation, GPT over-indexes on dream sequences, and Gemini defaults to external character description.

Which are all ways of creating more text without saying anything. Repetition is another classic.

I feel like that's a problem with all low-effort, AI-generated texts (which is the vast majority of them): You give it a prompt with maybe ten pieces of information and expect it to generate a text that's a hundred times as long, while also not straying too far from the prompt.

Of course, it's going to take every opportunity to not say anything that would advance the plot. Because advancing the plot means either using up the little input you gave it, or to invent new information which might contradict the prompt...

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 11 Jul 2026
407 points (99.3% liked)

Fuck AI

7604 readers
1043 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS