Just two weeks til' Halloween now.

Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 1 day ago (4 children)

Quick Q, from where does the weird term "abliteration" come from? I've seen it used for "jailbroken" GenAI models.

  • source
  • hideshow 4 child comments
  • [–] 7 points 1 day ago* (last edited 1 day ago) (1 child)

    With a bit of google searching by date it seems like this guy (https://huggingface.co/failspy/Meta-Llama-3-70B-Instruct-abliterated-v3.5) claims ownership of the coining, which I find plausible, based on the list of released weights and their timing.

    As far as "abliteration": it's just a fun play-on-words using the original "ablation" term used in the original paper to refer to removing features, which I made up particularly to differentiate the model from "uncensored" fine-tunes. Ablate + obliterated = Abliterated.

    The paper being referred to being: Refusal in Language Models Is Mediated by a Single Direction which seems to have somehow started out on the "AI alignement forum" of LessWrong https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction first posted 27th of April 2024. In general it's a method of weight alteration so only really applicable to some opensource (or i guess leaked) models.

    First model with abliterated in the name by "failspy" on 8th of May 2024.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 1 day ago*

    wiktionary claims it is a blend of "ablate" and "obliterate", it does not list an origin (at this point in time)

    edit: looking a little more into this, knowing the etymology requires reading about AI discussions which I am not prepared for at this point in time but it is out there in the internet

  • source
  • parent