Release the Epstein file then you coward.

It would be nice if we could read more than 3 paragraphs of the article.

Copied this from a crosspost: https://removepaywalls.com/https://www.businessinsider.com/ai-giants-learn-hard-truth-modern-internet-anthropic-openai-google-2026-7

Glad that we can take their work for free to. Hopefully the community can produce open weight models that run locally so we don't need to pay these fools.

Yum .. Unsupervised Text Extruders are now digesting the Excrement from their Assumed Intelligence overlord's competitors.

Can't wait to smell the results ...

I'm not the most knowledgeable about LLMs, but I don't see the threat distillation is supposed to pose.

Surely what you'd get from training something on a model's outputs and reasoning chain would just get you something that sounds like that model. The model won't magically become more intelligent just because it's trained on data from a smarter model. It doesn't have the relevant vectors and mathematics, it's only got the text output. A lot of the model changes tend to be architectural than just more data these days.

At least from my layman's viewpoint, it seems very much like claiming that watching television would let someone build a better television just from what they saw. The whole fear around distillation just sounds like nonsense.

Welcome to the new internet, Anthropic, OpenAI, and Google. Get used to it.