Yum .. Unsupervised Text Extruders are now digesting the Excrement from their Assumed Intelligence overlord's competitors.
Can't wait to smell the results ...
It would be nice if we could read more than 3 paragraphs of the article.
Copied this from a crosspost: https://removepaywalls.com/https://www.businessinsider.com/ai-giants-learn-hard-truth-modern-internet-anthropic-openai-google-2026-7
Glad that we can take their work for free to. Hopefully the community can produce open weight models that run locally so we don't need to pay these fools.
Fuck AI
Welcome to the new internet, Anthropic, OpenAI, and Google. Get used to it.
I'm not the most knowledgeable about LLMs, but I don't see the threat distillation is supposed to pose.
Surely what you'd get from training something on a model's outputs and reasoning chain would just get you something that sounds like that model. The model won't magically become more intelligent just because it's trained on data from a smarter model. It doesn't have the relevant vectors and mathematics, it's only got the text output. A lot of the model changes tend to be architectural than just more data these days.
At least from my layman's viewpoint, it seems very much like claiming that watching television would let someone build a better television just from what they saw. The whole fear around distillation just sounds like nonsense.
Release the Epstein file then you coward.
...what does that have to do with this?
Don't you know that everything is now just a distraction from the files, every influential person has their fingers in keeping them locked away and every journalist reporting on anything else is just part of the distraction effort?
I get that people don't want the issue to be swept under the rug, and I agree that there probably is a lot more awful shit in there, but because it's everywhere, it's starting to just become background noise. In the attempt to keep the topic from insignificance, they're wearing it out.
Besides, while past atrocities are definitely worth examining, I'm personally more concerned about present and near-future ones. Justice won't un-rape the children, but unchecked AI grift is burning the future.
I didn't realize Alistair Barr had that kind of power.
File? Singular?
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.