22
Generators Making CP........Just NO! (thelemmy.club)
submitted 5 months ago by to c/perchance@lemmy.world
25 comments fedilink hide all child comments
 

I'm so angry I'm shaking while typing this. Many others and I have reported this one alone, and it's still here! It looks like it's gotten more tabs to try to hide.

Please. Ban this filth. This is NOT okay.

There is no valid reason for children to be made on a generator that allows NSFW. And some of the tabs are filthy when I think of them in the context of CP.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago* (3 children)

Yeah, I think something like that would be very useful and helpful. Its easier to use pre-made tools or features and integrating in your project or service. Consulting other projects is a smart thing to do because they can give you some insight about filters and censorship, stuff like. Filter for the Fediverse, like this one: https://github.com/db0/fedi-safety? Seems interesting, I also remember AI Horde, I think I used it a couple of times. It's great their filtering works as intended. I think the dev should take this advice, and maybe even hire or consult somebody to help him with this. I am not programmer or coder (I can't do this shiii without Microsoft's Copilot, it was the one helping with all the coding and troubleshooting lol. ) but maybe I can make a "filter" example, albeit a simple one, just as an example. I'd rather have filtered out words than Grok's horrible use of censorship, blurring images that's not even NSFW...

I kinda wanna aim for:

(child) ≠ [forbidden word]

or

(little\young\small) | girl/boy/child ≠ [forbidden word] Note: No specific order. Just the words contained in ( ) with (like girl/boy/child) to let the filter know to filter those forbidden words out those in combination of the other words.

(of course not the only one)

Filter system shouldn't censor innocent prompts, but rather specific ones based off the instructions its given. Child ≠ forbidden word example I've provided is a good way to add censorship without blurring images that uses the prompt: Two adults, Sally and Tom lays in bed together, wearing underwear. Sally wears bras and panties and Tom is shirtless in boxers. A prompt like this shouldn't be censored because Sally and Tom are adults, yet why is being censored anyways? If it allows NSFW as long as the adults are characters, then it shouldn't be an issue. This was Grok's mistake: allowing NSFW but had to enforce stricter censorship because the dumbahh developers allowed Twitter users to edited pictures in posts and creeps and pedos made sexualized images of women and children. Now Grok users can't generate any NSFW content involving consensual, legal adult characters only, after being marketed as "unrestricted/uncensored" type AI image generator. This is the type of issue we want to avoid. Perchance allows NSFW and not have this "family friendly" or "all ages" image. So allow NSFW content for any prompt containing adult-aged characters only. Shouldn't be too hard...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 4 months ago (2 children)

    I'm thinking like (for programming filter only):

    contains/includes/with = (words go here) exclude/omit = (words go here)

    Now, you can't include everything at first, just keep adding and refining the filters over time or from reports from users. Very minor idea:

    Words (adjective, noun): little, young, small, tiny Containing/including with (nouns): boy, girl, child, kid

    (can even add suffix/prefix for like pre-teen, pre-adolescent, etc)

    Exclude/omit from (adjective, verb, adverb, preposition): [you get the idea]

    if there's a word with (-s, -es, -ed) would also include that too...

    This tells the filter to what to scan or analyze for. Whether the words are categorized or not (doesn't matter) the core concept remains the same. I think there may be similar pre-made solutions or tools on github like my idea, I would also look into those. Its not as hard as you think, just a bit time consuming to configure...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 4 months ago* (last edited 4 months ago) (1 child)

    Yes. https://github.com/db0/fedi-safety is the Fedi code. And it leverages this project:

    https://github.com/Haidra-Org/horde-safety/

    Mind you're currently in the process of fleshing out your own interpretation of the wheel. My recommendation was not to do that. And your approach has the usual downsides: People can use other words, synonyms. Describe it. Or leverage wrong spellings. Jam an adjective in-between. Do an exact request, but in Chinese language... All that will circumvent filtering by simple word filters. And that's usually what happens 5 minutes after you roll out such a system. It's a) pretty much not effective at all. And b) it's complicated and you'll end up in a cat and mouse game.

    Fedi-/Horde-Safety use an image interrogator, to query what's actually in the image. That's immune to that. They also have all these heuristics. (You can have a look in their code.) It'll come with false-positives, though. It's a trade-off.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 months ago

    Ah, okay. I see horde-safety kinda like integrates the Fedi code in their filters.

    Fedi-/Horde-Safety use an image interrogator, to query what’s actually in the image. That’s immune to that. They also have all these heuristics. (You can have a look in their code.) It’ll come with false-positives, though. It’s a trade-off.

    Huh, now that's pretty interesting. I will defiantly take a look into their code, I want to see how they programmed it.

    Mind you’re currently in the process of fleshing out your own interpretation of the wheel. My recommendation was not to do that. And your approach has the usual downsides: People can use other words, synonyms. Describe it. Or leverage wrong spellings. Jam an adjective in-between. Do an exact request, but in Chinese language… All that will circumvent filtering by simple word filters. And that’s usually what happens 5 minutes after you roll out such a system. It’s a) pretty much not effective at all. And b) it’s complicated and you’ll end up in a cat and mouse game.

    Yeeaaaahhhh...I just realized that that now...emphasis on the process of fleshing out my own interpretation. I wouldn't recommend as something to actually make and integrate as censorship. I think I was literally doing that, trying to showcase how I thought how the censorship/filtering worked, like the basics of it...I knew it wouldn't be as accurate or effective because not all censorship/filters actually work like that...I guess in my head it was more of a "demonstration" rather than an actual tool/solution. I think I meant to demonstrate how the censorship/filter on what words and associations to focus on instead of banning innocent prompts because of too much censorship (Unfortunatly, that what Grok does. Because they effed up knowing releasing the ability someone's post without consent and now it all backfired, cranking up the censorship and making it practically unusable. And the fact the government is enforcing it also makes it worse) ...But you are 100% right: its not effective since people can use ways to circumvent the filter like you said, use different words, synonyms, mispellings, sentences, etc. (Man, I wouldn't be too surprised if it was less than 5 minutes...its insane...). Very ineffective and complicated...I just thought about its trying to keep adding words when people can bypass is hard as hell. And the cat and mouse game? God, couldn't be more true. Trying to add more words to the filter and people STILL find ways to bypass would be exhausting.

  • permalink
  • fedilink
  • source
  • parent