17
🤔
But it was incorrect at 15,823 tokens per second!
Well now what?
AMD might win the "AI race" with this. Let the other ones fall, then come in with affordable purpose built hardware that's actually useful.
The general service model won't keep working forever, but a chip that's specifically designed to like translate from Spanish to English, or OCR documents, or whatever other specific LLM task you need is a product that can be sold repeatedly.
On the specific chip, I've seen another format called compute-in-memory from Anker.
So it will be interesting to see what comes out of the AI tech race.
I think the GPU model of "a thing you jam data into and get a thing out" is gonna become more common. Baking a network into a chip is more efficient than fpgas too.
I found a YouTube link in your comment. Here are links to the same video on alternative frontends that protect your privacy:
I found a YouTube link in your post. Here are links to the same video on alternative frontends that protect your privacy:
this post was submitted on 07 Aug 2026
17 points (100.0% liked)
technology
24439 readers
287 users here now
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
- Ways to run Microsoft/Adobe and more on Linux
- The Ultimate FOSS Guide For Android
- Great libre software on Windows
- Hey you, the lib still using Chrome. Read this post!
Rules:
- 1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
- 2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
- 3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
- 4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
- 5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
- 6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
- 7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.
founded 6 years ago
MODERATORS