▲ 350 ▼ Meta So Desperate for Compute That It’s Building “Data Centers” That Are Just Tents Filled With AI Chips (tech.yahoo.com) submitted 3 months ago by sanitation@lemmy.today to c/technology@lemmy.world 60 comments fedilink hide all child comments
[–] Mwa 28 points 3 months ago (5 children) Maybe optimize the LLM to run on less compute? permalink fedilink source hideshow 10 child comments replies: [–] gravitas_deficiency@sh.itjust.works 13 points 3 months ago* (last edited 3 months ago) (3 children) Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage. ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, I’m extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage. permalink fedilink source parent hideshow 6 child comments replies: [–] eleitl@lemmy.zip 4 points 3 months ago (1 child) Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay. permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 2 points 3 months ago I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”. permalink fedilink source parent [–] REDACTED@infosec.pub 2 points 3 months ago* Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe Funny, but it's actually a bit worse. People are literally falling in love with it and generally go nuts. This is not even getting into the whole "it's conscious". You're essentially living in a bubble and don't really know how bad it is. Don't look up how many use character.ai EDIT: On a related note, it's slightly annoying that Lemmy converts links like.it, without me providing https:// permalink fedilink source parent [–] Mwa 1 point 3 months ago (1 child) maybe this is personal preference permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago (1 child) ? permalink fedilink source parent hideshow 2 child comments replies: [–] motruck@lemmy.zip 1 point 3 months ago (1 child) Analog meaning think for yourself or what? permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent [–] datendefekt@feddit.org 11 points 3 months ago (1 child) Don't worry, Chinese LLM vendors without access to the newest hardware will take care of that. permalink fedilink source parent hideshow 2 child comments replies: [–] Mwa -2 points 3 months ago* (last edited 3 months ago) based,hopefully they use this to optimize local LLMS so i have higher tokens per second. permalink fedilink source parent [–] Miller@lemmy.world 3 points 3 months ago Stop talking sense when has good sense ever been the solution of choice. permalink fedilink source parent [–] Blackfeathr@lemmy.world 3 points 3 months ago* But everything's computer! permalink fedilink source parent [–] dan1101@lemmy.world 1 point 3 months ago (1 child) If I was king they would have to run on 100% on-site solar and air cooling. permalink fedilink source parent hideshow 2 child comments replies: [–] Mwa 3 points 3 months ago would be based permalink fedilink source parent
[–] gravitas_deficiency@sh.itjust.works 13 points 3 months ago* (last edited 3 months ago) (3 children) Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe, and that the true power of this technical domain lies in more targeted and bespoke ML model generation and usage. ML is good and enables - and has enabled - some genuine generational leaps in science and technology. But LLMs are such a fucking waste of the technology’s potential. Not to mention, I’m extremely irritated that (largely due to Nvidia cornering the market) everyone is super gung-ho about a digital approach which amounts to brute-forcing neural nets digitally with shitloads of memory and highly-parallel compute, when it’s obvious to anyone with more than a passing familiarity with electrical engineering that an analog approach is going to be FAR more efficient in terms of resource and energy usage. permalink fedilink source parent hideshow 6 child comments replies: [–] eleitl@lemmy.zip 4 points 3 months ago (1 child) Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay. permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 2 points 3 months ago I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”. permalink fedilink source parent [–] REDACTED@infosec.pub 2 points 3 months ago* Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe Funny, but it's actually a bit worse. People are literally falling in love with it and generally go nuts. This is not even getting into the whole "it's conscious". You're essentially living in a bubble and don't really know how bad it is. Don't look up how many use character.ai EDIT: On a related note, it's slightly annoying that Lemmy converts links like.it, without me providing https:// permalink fedilink source parent [–] Mwa 1 point 3 months ago (1 child) maybe this is personal preference permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago (1 child) ? permalink fedilink source parent hideshow 2 child comments replies: [–] motruck@lemmy.zip 1 point 3 months ago (1 child) Analog meaning think for yourself or what? permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent
[–] eleitl@lemmy.zip 4 points 3 months ago (1 child) Yeah, for 4 and 8 bit quantization at least analog charge buckets or memristor-likes and analog multipliers would dramatically reduce substrate size, reduce power burn and speed up inference. Even better killer drones, here they come. Yay. permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 2 points 3 months ago I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”. permalink fedilink source parent
[–] gravitas_deficiency@sh.itjust.works 2 points 3 months ago I mean… yeah, DARPA will probably be one of the first adopters of that stuff, it’s true. But DARPA is pretty much always a first adopter of any new tech, because they’re basically the research wing of the US military, and they have effectively infinite resources at their disposal (note: I am not debating whether or not that is a good thing here; simply stating that it is a thing). But just because they’ll likely do something military-ish with it first doesn’t mean that it’s a “bad” technology. The internet itself was, after all, initially a project of DARPA’s predecessor, ARPA, and was initially named “ARPAnet”. permalink fedilink source parent
[–] REDACTED@infosec.pub 2 points 3 months ago* Or just realize that nobody fucking likes LLMs as much as the Captains of Industry want us to believe Funny, but it's actually a bit worse. People are literally falling in love with it and generally go nuts. This is not even getting into the whole "it's conscious". You're essentially living in a bubble and don't really know how bad it is. Don't look up how many use character.ai EDIT: On a related note, it's slightly annoying that Lemmy converts links like.it, without me providing https:// permalink fedilink source parent
[–] Mwa 1 point 3 months ago (1 child) maybe this is personal preference permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago (1 child) ? permalink fedilink source parent hideshow 2 child comments replies: [–] motruck@lemmy.zip 1 point 3 months ago (1 child) Analog meaning think for yourself or what? permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent
[–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago (1 child) ? permalink fedilink source parent hideshow 2 child comments replies: [–] motruck@lemmy.zip 1 point 3 months ago (1 child) Analog meaning think for yourself or what? permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent
[–] motruck@lemmy.zip 1 point 3 months ago (1 child) Analog meaning think for yourself or what? permalink fedilink source parent hideshow 2 child comments replies: [–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent
[–] gravitas_deficiency@sh.itjust.works 1 point 3 months ago* Analog as in analog signals vs digital signals. Reductively: circuitry designed to operate in a continuously variable electrical domain, as opposed to circuitry designed to operate in a clocked binary domain. Analog is (with a LOT of handwaving) way closer to how biological neural nets (that is, actual neurological tissue) operates. This is one of many domains where the exploration of biomimicry could yield some incredible advantages in a lot of areas. permalink fedilink source parent
[–] datendefekt@feddit.org 11 points 3 months ago (1 child) Don't worry, Chinese LLM vendors without access to the newest hardware will take care of that. permalink fedilink source parent hideshow 2 child comments replies: [–] Mwa -2 points 3 months ago* (last edited 3 months ago) based,hopefully they use this to optimize local LLMS so i have higher tokens per second. permalink fedilink source parent
[–] Mwa -2 points 3 months ago* (last edited 3 months ago) based,hopefully they use this to optimize local LLMS so i have higher tokens per second. permalink fedilink source parent
[–] Miller@lemmy.world 3 points 3 months ago Stop talking sense when has good sense ever been the solution of choice. permalink fedilink source parent
[–] Blackfeathr@lemmy.world 3 points 3 months ago* But everything's computer! permalink fedilink source parent
[–] dan1101@lemmy.world 1 point 3 months ago (1 child) If I was king they would have to run on 100% on-site solar and air cooling. permalink fedilink source parent hideshow 2 child comments replies: [–] Mwa 3 points 3 months ago would be based permalink fedilink source parent