▲ 784 ▼ OpenAI is so cooked and I'm all here for it (lemmy.dbzer0.com) submitted 2 years ago by db0@lemmy.dbzer0.com to c/techtakes@awful.systems 207 comments fedilink hide all child comments
[–] stoicmaverick@lemmy.world 22 points 2 years ago (19 children) Can someone explain the Pale Horse reference? permalink fedilink source hideshow 19 child comments replies: [–] conditional_soup@lemm.ee 39 points 2 years ago* (18 children) In the Bible's book of revelations, John (the author) is witnessing the end of the world and sees four horsemen being unleashed upon the world to spread a curse/trial/whatever wherever they ride. Each horseman brings with them something different- famine, disease, war (or strife), and death. Death is the last, IIRC, and rides upon a pale horse. I think that's what they're referencing. This person is saying that openAI is going to die soon. permalink fedilink source parent hideshow 18 child comments replies: [–] froztbyte@awful.systems 7 points 2 years ago this is correct as to the background of the term itself, the reason ed uses it here is because it is the term that he selected some months ago when he listed “some likely pale horses that signal the bubble popping” permalink fedilink source parent [–] jatone@lemmy.dbzer0.com 0 points 2 years ago* (16 children) it won't. its backed by microsoft. they can literally afford to burn the cash on this while it becomes profitable, and it will AI has so many low hanging fruits to optimize its insane. permalink fedilink source parent hideshow 16 child comments replies: [–] Architeuthis@awful.systems 39 points 2 years ago* (2 children) So many low-hanging fruits. Unbelievable fruits. You wouldn’t believe how low they’re hanging. permalink fedilink source parent hideshow 2 child comments replies: [–] kopasz7@sh.itjust.works 32 points 2 years ago* (1 child) They are tremendous fruits. Many people are saying this. Fruits. permalink fedilink source parent hideshow 1 child comment replies: [–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent [–] Brutticus@lemm.ee 23 points 2 years ago (9 children) Okay, explain. What kinds of low hanging fruit? permalink fedilink source parent hideshow 9 child comments replies: [+] jatone@lemmy.dbzer0.com -13 points 2 years ago* (last edited 2 years ago) (8 children) quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically. edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid. permalink fedilink source parent hideshow 8 child comments replies: [–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent [–] self@awful.systems 21 points 2 years ago (1 child) the fruit can’t be rotten, you must be picking it wrong permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago “look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster permalink fedilink source parent [–] stoly@lemmy.world 6 points 2 years ago They will only pay as long as it benefits them. permalink fedilink source parent
[–] conditional_soup@lemm.ee 39 points 2 years ago* (18 children) In the Bible's book of revelations, John (the author) is witnessing the end of the world and sees four horsemen being unleashed upon the world to spread a curse/trial/whatever wherever they ride. Each horseman brings with them something different- famine, disease, war (or strife), and death. Death is the last, IIRC, and rides upon a pale horse. I think that's what they're referencing. This person is saying that openAI is going to die soon. permalink fedilink source parent hideshow 18 child comments replies: [–] froztbyte@awful.systems 7 points 2 years ago this is correct as to the background of the term itself, the reason ed uses it here is because it is the term that he selected some months ago when he listed “some likely pale horses that signal the bubble popping” permalink fedilink source parent [–] jatone@lemmy.dbzer0.com 0 points 2 years ago* (16 children) it won't. its backed by microsoft. they can literally afford to burn the cash on this while it becomes profitable, and it will AI has so many low hanging fruits to optimize its insane. permalink fedilink source parent hideshow 16 child comments replies: [–] Architeuthis@awful.systems 39 points 2 years ago* (2 children) So many low-hanging fruits. Unbelievable fruits. You wouldn’t believe how low they’re hanging. permalink fedilink source parent hideshow 2 child comments replies: [–] kopasz7@sh.itjust.works 32 points 2 years ago* (1 child) They are tremendous fruits. Many people are saying this. Fruits. permalink fedilink source parent hideshow 1 child comment replies: [–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent [–] Brutticus@lemm.ee 23 points 2 years ago (9 children) Okay, explain. What kinds of low hanging fruit? permalink fedilink source parent hideshow 9 child comments replies: [+] jatone@lemmy.dbzer0.com -13 points 2 years ago* (last edited 2 years ago) (8 children) quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically. edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid. permalink fedilink source parent hideshow 8 child comments replies: [–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent [–] self@awful.systems 21 points 2 years ago (1 child) the fruit can’t be rotten, you must be picking it wrong permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago “look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster permalink fedilink source parent [–] stoly@lemmy.world 6 points 2 years ago They will only pay as long as it benefits them. permalink fedilink source parent
[–] froztbyte@awful.systems 7 points 2 years ago this is correct as to the background of the term itself, the reason ed uses it here is because it is the term that he selected some months ago when he listed “some likely pale horses that signal the bubble popping” permalink fedilink source parent
[–] jatone@lemmy.dbzer0.com 0 points 2 years ago* (16 children) it won't. its backed by microsoft. they can literally afford to burn the cash on this while it becomes profitable, and it will AI has so many low hanging fruits to optimize its insane. permalink fedilink source parent hideshow 16 child comments replies: [–] Architeuthis@awful.systems 39 points 2 years ago* (2 children) So many low-hanging fruits. Unbelievable fruits. You wouldn’t believe how low they’re hanging. permalink fedilink source parent hideshow 2 child comments replies: [–] kopasz7@sh.itjust.works 32 points 2 years ago* (1 child) They are tremendous fruits. Many people are saying this. Fruits. permalink fedilink source parent hideshow 1 child comment replies: [–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent [–] Brutticus@lemm.ee 23 points 2 years ago (9 children) Okay, explain. What kinds of low hanging fruit? permalink fedilink source parent hideshow 9 child comments replies: [+] jatone@lemmy.dbzer0.com -13 points 2 years ago* (last edited 2 years ago) (8 children) quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically. edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid. permalink fedilink source parent hideshow 8 child comments replies: [–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent [–] self@awful.systems 21 points 2 years ago (1 child) the fruit can’t be rotten, you must be picking it wrong permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago “look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster permalink fedilink source parent [–] stoly@lemmy.world 6 points 2 years ago They will only pay as long as it benefits them. permalink fedilink source parent
[–] Architeuthis@awful.systems 39 points 2 years ago* (2 children) So many low-hanging fruits. Unbelievable fruits. You wouldn’t believe how low they’re hanging. permalink fedilink source parent hideshow 2 child comments replies: [–] kopasz7@sh.itjust.works 32 points 2 years ago* (1 child) They are tremendous fruits. Many people are saying this. Fruits. permalink fedilink source parent hideshow 1 child comment replies: [–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent
[–] kopasz7@sh.itjust.works 32 points 2 years ago* (1 child) They are tremendous fruits. Many people are saying this. Fruits. permalink fedilink source parent hideshow 1 child comment replies: [–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent
[–] mojofrododojo@lemmy.world 16 points 2 years ago and we have concepts for even lower hanging fruits. beautiful concepts. permalink fedilink source parent
[–] Brutticus@lemm.ee 23 points 2 years ago (9 children) Okay, explain. What kinds of low hanging fruit? permalink fedilink source parent hideshow 9 child comments replies: [+] jatone@lemmy.dbzer0.com -13 points 2 years ago* (last edited 2 years ago) (8 children) quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically. edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid. permalink fedilink source parent hideshow 8 child comments replies: [–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent
[+] jatone@lemmy.dbzer0.com -13 points 2 years ago* (last edited 2 years ago) (8 children) quants are pretty basic. switching from floats to ints (faster instruction sets) are the well known issues. both those are related to information theory, but there are other things I legally can't mention. shrug. suffice to say the model sizes are going to be decreasing dramatically. edit: the first two points require reworking the base infrastructure to support which is why they havent hit widespread adoption. but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. that reduction alone means you can get 21x reduction in model size is pretty solid. permalink fedilink source parent hideshow 8 child comments replies: [–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent
[–] self@awful.systems 26 points 2 years ago (7 children) both those are related to information theory, but there are other things I legally can’t mention. shrug. hahahaha fuck off with this. no, the horseshit you’re fetishizing doesn’t fix LLMs. here’s what quantization gets you: the LLM runs on shittier hardware the LLM works worse too that last one’s kinda bad when the technology already works like shit anyway speaking of basic information theory: but the research showing that 3 bits is as good as 64 is intuitive once you tie the original inspiration for some of the AI designs. lol permalink fedilink source parent hideshow 7 child comments replies: [–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent [–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent [–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent
[–] eestileib@sh.itjust.works 13 points 2 years ago* Honestly, the research showing that a schlong that's 3mm wide is just as satisfying as one that's 64 is intuitive once you tie the original inspiration for some of the sex positions. permalink fedilink source parent
[–] killingspark@feddit.org 12 points 2 years ago (3 children) I have seen these 3 bit ai papers on hacker news a few times. And the takeaway apparently is: the current models are being pretty shitty at what we want them to do, and we can reach a similar (but slightly worse) level of shittyness with 3 bits. But that doesn't say anything about how both technologies could progress in the future. I guess you can compensate for having only three bits to pass between nodes by just having more nodes. But that doesn't really seem helpful, neither for storage nor compute. Anyways yeah it always strikes me as a kind of trend that maybe has an application in a very specific niche but is likely bullshit if applied to the general case permalink fedilink source parent hideshow 3 child comments replies: [–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent [–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent
[–] V0ldek@awful.systems 13 points 2 years ago (1 child) If anything that sounds like an indictment? Like, the current models are so incredibly fucking bad that we could achieve the same with three bits and a ham sandwich permalink fedilink source parent hideshow 1 child comment replies: [–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent
[–] killingspark@feddit.org 5 points 2 years ago Oh it definitely says something about the current models for sure permalink fedilink source parent
[–] BlueMonday1984@awful.systems 4 points 2 years ago Far as I can tell, the only real benefit here is significant energy savings, which would take LLMs from "useless waste of a shitload of power" to "useless waste of power". permalink fedilink source parent
[–] khalid_salad@awful.systems 7 points 2 years ago (1 child) It's actually super easy to increase the accuracy of LLMs. import pytorch # or ollama or however you fucking dorks use this nonsense from decimal import Decimal I left out all the other details because it's pretty intuitive why it works if you understand why floats have precision issues. permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent
[–] froztbyte@awful.systems 5 points 2 years ago decimal is a severely underappreciated library permalink fedilink source parent
[–] self@awful.systems 21 points 2 years ago (1 child) the fruit can’t be rotten, you must be picking it wrong permalink fedilink source parent hideshow 1 child comment replies: [–] froztbyte@awful.systems 5 points 2 years ago “look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster permalink fedilink source parent
[–] froztbyte@awful.systems 5 points 2 years ago “look, Mme Karen, this is definitely not a rotten tomato. it can’t be a rotten tomato, we don’t sell rotten tomatoes. you can see here on the menu that we don’t have rotten tomatoes on offer. and see here, on your receipt, where it says quinoa salad? absolutely not rotten tomatoes!” explains the manager fervently, avoiding a tableward glance at the pungent red blob with as much will as they can muster permalink fedilink source parent
[–] stoly@lemmy.world 6 points 2 years ago They will only pay as long as it benefits them. permalink fedilink source parent