289
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 09 Jun 2026
289 points (98.3% liked)
Technology
85274 readers
4643 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 3 years ago
MODERATORS
Maybe optimize the LLM to run on less compute?
Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage.
ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, I’m extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage.
Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay.
I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”.
maybe this is personal preference
?
Analog meaning think for yourself or what?
Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain.
Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas.
Don't worry, Chinese LLM vendors without access to the newest hardware will take care of that.
based,hopefully they use this to optimize local LLMS so i have higher tokens per second.
Stop talking sense when has good sense ever been the solution of choice.
But everything's computer!
If I was king they would have to run on 100% on-site solar and air cooling.
would be based