▲ 424 ▼ Linus Torvalds used AI to fix a Linux bug, and now LLM critics on Linux face an uncomfortable choice (www.xda-developers.com) submitted 1 month ago by themachinestops@lemmy.dbzer0.com to c/technology@lemmy.world 491 comments fedilink hide all child comments https://lists.debian.org/debian-project/2026/08/msg00041.html
[+] Yewb@lemmy.world -13 points 1 month ago (9 children) That is absolutely not how it works at all permalink fedilink source parent hideshow 9 child comments replies: [–] Muehe@lemmy.ml 24 points 1 month ago (7 children) What do you mean? That's exactly how LLMs work. That's why they "hallucinate". permalink fedilink source parent hideshow 7 child comments replies: [+] architect -14 points 1 month ago* (6 children) No they hallucinate because they lose context but are tasked to answer anyways. They also don’t really lose context as much as they did a year ago. Their training data has nothing to do with it unless you’re using a local one without web access. permalink fedilink source parent hideshow 6 child comments replies: [–] Zaktor@sopuli.xyz 12 points 1 month ago (3 children) ML is my career and I've been doing it for decades. You're wrong. LLMs hallucinate with full context. permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 4 points 1 month ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent [–] SnoopSqueak@lemmy.today 2 points 1 month ago Their training data has nothing to do with it unless you’re using a local one without web access. Did you know that the ones you access online are also trained? Did you know that any chatbot that can connect to the web was given that capability? permalink fedilink source parent [–] Muehe@lemmy.ml 0 points 1 month ago No they hallucinate because they lose context but are tasked to answer anyways. Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size "hallucinate" because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other. permalink fedilink source parent [–] victorz@lemmy.world 15 points 1 month ago Uh huh, and how does it work? permalink fedilink source parent
[–] Muehe@lemmy.ml 24 points 1 month ago (7 children) What do you mean? That's exactly how LLMs work. That's why they "hallucinate". permalink fedilink source parent hideshow 7 child comments replies: [+] architect -14 points 1 month ago* (6 children) No they hallucinate because they lose context but are tasked to answer anyways. They also don’t really lose context as much as they did a year ago. Their training data has nothing to do with it unless you’re using a local one without web access. permalink fedilink source parent hideshow 6 child comments replies: [–] Zaktor@sopuli.xyz 12 points 1 month ago (3 children) ML is my career and I've been doing it for decades. You're wrong. LLMs hallucinate with full context. permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 4 points 1 month ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent [–] SnoopSqueak@lemmy.today 2 points 1 month ago Their training data has nothing to do with it unless you’re using a local one without web access. Did you know that the ones you access online are also trained? Did you know that any chatbot that can connect to the web was given that capability? permalink fedilink source parent [–] Muehe@lemmy.ml 0 points 1 month ago No they hallucinate because they lose context but are tasked to answer anyways. Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size "hallucinate" because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other. permalink fedilink source parent
[+] architect -14 points 1 month ago* (6 children) No they hallucinate because they lose context but are tasked to answer anyways. They also don’t really lose context as much as they did a year ago. Their training data has nothing to do with it unless you’re using a local one without web access. permalink fedilink source parent hideshow 6 child comments replies: [–] Zaktor@sopuli.xyz 12 points 1 month ago (3 children) ML is my career and I've been doing it for decades. You're wrong. LLMs hallucinate with full context. permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 4 points 1 month ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent [–] SnoopSqueak@lemmy.today 2 points 1 month ago Their training data has nothing to do with it unless you’re using a local one without web access. Did you know that the ones you access online are also trained? Did you know that any chatbot that can connect to the web was given that capability? permalink fedilink source parent [–] Muehe@lemmy.ml 0 points 1 month ago No they hallucinate because they lose context but are tasked to answer anyways. Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size "hallucinate" because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other. permalink fedilink source parent
[–] Zaktor@sopuli.xyz 12 points 1 month ago (3 children) ML is my career and I've been doing it for decades. You're wrong. LLMs hallucinate with full context. permalink fedilink source parent hideshow 3 child comments replies: [+] natecox@programming.dev 4 points 1 month ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[+] natecox@programming.dev 4 points 1 month ago* (last edited 1 week ago) (2 children) [deleted] permalink fedilink source parent hideshow 2 child comments replies: [–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[–] Croquette@sh.itjust.works 1 point 1 month ago (1 child) ML is still very useful and used everyday. LLM could have been a nice tool in niche applications, but instead, big capitalists ruined that for us, and torching the environment and wrecking the economy with it instead. permalink fedilink source parent hideshow 1 child comment replies: [+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[+] natecox@programming.dev 1 point 1 month ago* (last edited 1 week ago) [deleted] permalink fedilink source parent
[–] SnoopSqueak@lemmy.today 2 points 1 month ago Their training data has nothing to do with it unless you’re using a local one without web access. Did you know that the ones you access online are also trained? Did you know that any chatbot that can connect to the web was given that capability? permalink fedilink source parent
[–] Muehe@lemmy.ml 0 points 1 month ago No they hallucinate because they lose context but are tasked to answer anyways. Nothing to do with context. Context windows are an LLM specific thing, but all neural networks no matter the kind or size "hallucinate" because they are a piece of linear algebra where you put numbers in on one side and get numbers out the other. permalink fedilink source parent
[–] victorz@lemmy.world 15 points 1 month ago Uh huh, and how does it work? permalink fedilink source parent