technology

23303 readers

17 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.

founded 4 years ago

MODERATORS

[email protected]

AI Appears to Rapidly Be Approaching Brick Wall Where It Can't Get Smarter (futurism.com)

submitted 5 months ago by [email protected] to c/[email protected]

47 comments fedilink hide all child comments

The big AI models are running out of training data (and it turns out most of the training data was produced by fools and the intentionally obtuse), so this might mark the end of rapid model advancement

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 8 points 5 months ago

Seems like the article is talking specifically about LLMs. I think there is already enough data to train the technology that tech companies purport LLMs to be. They will have to develop the technology further, which I don't know is something that AI companies are focusing on. It seems like there is only so much one can with training models to learn what words means only in relation to other words.