90
submitted 12 hours ago* (last edited 10 hours ago) by supersquirrel@sopuli.xyz to c/fuck_ai@lemmy.world

Semantic ablation is the algorithmic erosion of high-entropy information. Technically, it is not a "bug" but a structural byproduct of greedy decoding and RLHF (reinforcement learning from human feedback).

During "refinement," the model gravitates toward the center of the Gaussian distribution, discarding "tail" data – the rare, precise, and complex tokens – to maximize statistical probability. Developers have exacerbated this through aggressive "safety" and "helpfulness" tuning, which deliberately penalizes unconventional linguistic friction. It is a silent, unauthorized amputation of intent, where the pursuit of low-perplexity output results in the total destruction of unique signal.

"No wonder politicians are so enamoured by AI.." -> Anonymous Coward in the comments of this article

you are viewing a single comment's thread
view the rest of the comments
[-] WolfLink@sh.itjust.works 6 points 10 hours ago
[-] errer@lemmy.world 6 points 7 hours ago

Sure it is you uh…hold on let me sample the tail distribution for an insult…you snollygoster!

[-] Infrapink@thebrainbin.org 4 points 5 hours ago

Who you calling a snollygoster, you wangdoodle?!

[-] Luccus@feddit.org 4 points 6 hours ago* (last edited 6 hours ago)

It's called XTC (exclude top choice) and is implented in a bunch of sorters. It's also used to jailbreak a bunch of models.

Edit: https://github.com/oobabooga/text-generation-webui/pull/6335

this post was submitted on 17 Feb 2026
90 points (98.9% liked)

Fuck AI

5858 readers
1643 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS