Let's go, already!
How you can help: If you run a website and can filter traffic by user agent, get a list of the known AI scrapers agent strings and selectively redirect their requests to pre-generated AI slop. Regular visitors will see the content and the LLM scraper bots will scrape their own slop and, hopefully, train on it.
It is their own fault for poisoning the internet with their slop.
More like... Degenerative AI *ba dum tsss
Model collapse is just a euphemism for “we ran out of stuff to steal”
Every single one of us, as kids, learned the concept of "garbage in, garbage out"; most likely in terms of diet and food intake.
And yet every AI cultist makes the shocked pikachu face when they figure out that trying to improve your LLM by feeding it on data generated by literally the inferior LLM you're trying to improve, is an exercise in diminishing returns and generational degradation in quality.
Why has the world gotten both "more intelligent" and yet fundamentally more stupid at the same time? Serious question.
This sounds like AI is literally biting its own tail
…………………. Good?
So AI:
Ah, the Hapsburg of AI!
So they made garbage AI content, without any filtering for errors, and they fed that garbage to the new model, that turned out to produce more garbage. Incredible discovery!
Old news? Seems to be a subject of several papers for some time now. Synthetic data has been used successfully already for very specific domains.
Uh, good.
As an engineer who cares a LOT about engineering ethics, it is absolutely fucking infuriating watching the absolute firehose of shit that comes out of LLMs and public-consumption audio, image, and video ML systems, juxtaposed with the outright refusal of companies and engineers who work there to accept ANY accountability or culpability for the systems THEY FUCKING MADE.
I understand the nuances of NNs. I understand that they’re much more stochastic than deterministic. So, you know, maybe it wasn’t a great idea to just tell the general public (which runs a WIDE gamut of intelligence and comprehension ability - not to mention, morality) “have at it”. The fact that ML usage and deployment in terms of information generating/kinda-sorta-but-not-really-aggregating “AI oracles” isn’t regulated on the same level as what you’d see in biotech or aerospace is insane to me. It’s a refusal to admit that these systems fundamentally change the entire premise of how “free speech” is generated, and that bad actors (either unrepentantly profit driven, or outright malicious) can and are taking disproportionate advantage of these systems.
I get it - I am a staunch opponent of censorship, and as a software engineer. But the flippant deployment of literally society-altering technology alongside the outright refusal to accept any responsibility, accountability, or culpability for what that technology does to our society is unconscionable and infuriating to me. I am aware of the potential that ML has - it’s absolutely enormous, and could absolutely change a HUGE number of fields for the better in incredible ways. But that’s not what it’s being used for, and it’s because the field is essentially unregulated right now.
oh no are we gonna have to appreciate the art of human beings? ew. what if they want compensation‽
Cool, let's try to ruin it faster!
I've been assuming this was going to happen since it's been haphazardly implemented across the web. Are people just now realizing it?
The solution for this is usually counter training. Granted my experience is on the opposite end training ai vision systems to id real objects.
So you train up your detector ai on hand tagged images. When it gets good you use it to train a generator ai until the generator is good at fooling the detector.
Then you train the detector on new tagged real data and the new ai generated data. Once it's good at detection again you train the generator ai on the new detector.
Repeate several times and you usually get a solid detector and a good generator as a side effect.
The thing is you need new real human tagged data for each new generation. None of the companies want to generate new human tagged data sets as it's expensive.
Good.
have we tried feeding them actual human beings yet ?
Looks like that artist drawing self portraits as his alzheimer got worse and worse.
Fake news, just like that one time Nightshade "killed" stable diffusion (literally had no effect) Flux came out not long ago and it's better than ever
this headline truly is threatening me with a good time
More like degenerative AIs
I think anyone familiar with the laws of thermodynamics could have predicted this outcome.
when all your information conflicts with itself, you really have no information at all.
Oh no. Anyways...
top 50 comments