▲ 163 ▼ G-Assist is ‘real’: NVIDIA unveils NitroGen, open-source AI model that can play 1000+ games for you (videocardz.com) submitted 9 months ago* (last edited 9 months ago) by themachinestops@lemmy.dbzer0.com to c/technology@lemmy.world 107 comments fedilink hide all child comments Why would I want AI to play the game other than for testing? https://nitrogen.minedojo.org/
[–] henfredemars@infosec.pub 176 points 9 months ago (11 children) I want AI to do my chores not play my games. permalink fedilink source hideshow 11 child comments replies: [–] themeatbridge@lemmy.world 45 points 9 months ago (1 child) Right? Like, figure out how to sort and fold laundry. permalink fedilink source parent hideshow 1 child comment replies: [+] Bluegrass_Addict@lemmy.ca 1 point 9 months ago [deleted] permalink fedilink source parent [–] givesomefucks@lemmy.world 18 points 9 months ago* Work is hard, modern games are easy. Shoot this dot, go to that dot, bring "x" to this dot... Anything requiring critical thinking like a puzzle, the bot just brute forces trying every possible outcome until something works. It works because games have a finite set of options and at least one progresses. The real world isn't that clean, and you don't get infinite chances to get 1 correct solution. permalink fedilink source parent [–] a_non_monotonic_function@lemmy.world 4 points 9 months ago Sorry, AI must only be inserted into places it isn't actually wanted. permalink fedilink source parent [–] Zos_Kia@lemmynsfw.com 3 points 9 months ago (5 children) Honestly I'd be curious about what a couple Minecraft bots could do. If you gave them a roadmap to endgame gear, what kind of farms would they build? permalink fedilink source parent hideshow 5 child comments replies: [–] kadu@scribe.disroot.org 6 points 9 months ago If they're as good at the game as LLMs are at writing, the bots would probably try to build a Nether portal using black wool instead of obsidian, then set it on fire, then die burning on said fire. permalink fedilink source parent [–] JackbyDev@programming.dev 1 point 9 months ago* (3 children) Sort of already exists as Baritone. https://github.com/cabaletta/baritone I'm not sure what all it can and can't do but it's pretty sophisticated. Edit: Note that, as far as I know, none of it is AI in the modern usage of the term. permalink fedilink source parent hideshow 3 child comments replies: [–] Zos_Kia@lemmynsfw.com 1 point 9 months ago (2 children) Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It's more of an automation framework, it's a terrific piece of software but not "AI". I've dicked around with a baritone+LLM setup but it's really hard to get the model to do anything worthwhile. The model doesn't really see the world around it, just whatever textual representation you manage to make of it. It's slow and frustrating and only gets the very basic tasks right. I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I'd love to see a civilization of bots building its own base with mega farms and shit... permalink fedilink source parent hideshow 2 child comments replies: [–] JackbyDev@programming.dev 1 point 9 months ago (1 child) Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually "AI" (not LLM AI but what we would've called AI pre LLM/gen AI lol). I don't remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it's much more involved than just clicking with a sword or aiming arrows.) permalink fedilink source parent hideshow 1 child comment replies: [–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent [–] Venator@lemmy.nz 1 point 9 months ago Silver lining: maybe it could be used to make some games more accessible for people with disabilities permalink fedilink source parent
[–] themeatbridge@lemmy.world 45 points 9 months ago (1 child) Right? Like, figure out how to sort and fold laundry. permalink fedilink source parent hideshow 1 child comment replies: [+] Bluegrass_Addict@lemmy.ca 1 point 9 months ago [deleted] permalink fedilink source parent
[–] givesomefucks@lemmy.world 18 points 9 months ago* Work is hard, modern games are easy. Shoot this dot, go to that dot, bring "x" to this dot... Anything requiring critical thinking like a puzzle, the bot just brute forces trying every possible outcome until something works. It works because games have a finite set of options and at least one progresses. The real world isn't that clean, and you don't get infinite chances to get 1 correct solution. permalink fedilink source parent
[–] a_non_monotonic_function@lemmy.world 4 points 9 months ago Sorry, AI must only be inserted into places it isn't actually wanted. permalink fedilink source parent
[–] Zos_Kia@lemmynsfw.com 3 points 9 months ago (5 children) Honestly I'd be curious about what a couple Minecraft bots could do. If you gave them a roadmap to endgame gear, what kind of farms would they build? permalink fedilink source parent hideshow 5 child comments replies: [–] kadu@scribe.disroot.org 6 points 9 months ago If they're as good at the game as LLMs are at writing, the bots would probably try to build a Nether portal using black wool instead of obsidian, then set it on fire, then die burning on said fire. permalink fedilink source parent [–] JackbyDev@programming.dev 1 point 9 months ago* (3 children) Sort of already exists as Baritone. https://github.com/cabaletta/baritone I'm not sure what all it can and can't do but it's pretty sophisticated. Edit: Note that, as far as I know, none of it is AI in the modern usage of the term. permalink fedilink source parent hideshow 3 child comments replies: [–] Zos_Kia@lemmynsfw.com 1 point 9 months ago (2 children) Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It's more of an automation framework, it's a terrific piece of software but not "AI". I've dicked around with a baritone+LLM setup but it's really hard to get the model to do anything worthwhile. The model doesn't really see the world around it, just whatever textual representation you manage to make of it. It's slow and frustrating and only gets the very basic tasks right. I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I'd love to see a civilization of bots building its own base with mega farms and shit... permalink fedilink source parent hideshow 2 child comments replies: [–] JackbyDev@programming.dev 1 point 9 months ago (1 child) Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually "AI" (not LLM AI but what we would've called AI pre LLM/gen AI lol). I don't remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it's much more involved than just clicking with a sword or aiming arrows.) permalink fedilink source parent hideshow 1 child comment replies: [–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent
[–] kadu@scribe.disroot.org 6 points 9 months ago If they're as good at the game as LLMs are at writing, the bots would probably try to build a Nether portal using black wool instead of obsidian, then set it on fire, then die burning on said fire. permalink fedilink source parent
[–] JackbyDev@programming.dev 1 point 9 months ago* (3 children) Sort of already exists as Baritone. https://github.com/cabaletta/baritone I'm not sure what all it can and can't do but it's pretty sophisticated. Edit: Note that, as far as I know, none of it is AI in the modern usage of the term. permalink fedilink source parent hideshow 3 child comments replies: [–] Zos_Kia@lemmynsfw.com 1 point 9 months ago (2 children) Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It's more of an automation framework, it's a terrific piece of software but not "AI". I've dicked around with a baritone+LLM setup but it's really hard to get the model to do anything worthwhile. The model doesn't really see the world around it, just whatever textual representation you manage to make of it. It's slow and frustrating and only gets the very basic tasks right. I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I'd love to see a civilization of bots building its own base with mega farms and shit... permalink fedilink source parent hideshow 2 child comments replies: [–] JackbyDev@programming.dev 1 point 9 months ago (1 child) Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually "AI" (not LLM AI but what we would've called AI pre LLM/gen AI lol). I don't remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it's much more involved than just clicking with a sword or aiming arrows.) permalink fedilink source parent hideshow 1 child comment replies: [–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent
[–] Zos_Kia@lemmynsfw.com 1 point 9 months ago (2 children) Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It's more of an automation framework, it's a terrific piece of software but not "AI". I've dicked around with a baritone+LLM setup but it's really hard to get the model to do anything worthwhile. The model doesn't really see the world around it, just whatever textual representation you manage to make of it. It's slow and frustrating and only gets the very basic tasks right. I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I'd love to see a civilization of bots building its own base with mega farms and shit... permalink fedilink source parent hideshow 2 child comments replies: [–] JackbyDev@programming.dev 1 point 9 months ago (1 child) Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually "AI" (not LLM AI but what we would've called AI pre LLM/gen AI lol). I don't remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it's much more involved than just clicking with a sword or aiming arrows.) permalink fedilink source parent hideshow 1 child comment replies: [–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent
[–] JackbyDev@programming.dev 1 point 9 months ago (1 child) Did you see the one where someone trained bots to do crystal pvp on 2b2t? It was fascinating and actually "AI" (not LLM AI but what we would've called AI pre LLM/gen AI lol). I don't remember much else. Basically the bots actually saw the screen, not at full resolution, but enough to really see and move and attack players in a very advanced way. (Crystal PVP involves putting down end crystals and detonating them, it's much more involved than just clicking with a sword or aiming arrows.) permalink fedilink source parent hideshow 1 child comment replies: [–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent
[–] Zos_Kia@lemmynsfw.com 2 points 9 months ago I totally missed that ! Thanks for the reference I'll try to find it. I used to hang with a crew that was really into crystal pvp, this brings back memories. Personally I find it pretty boring but the coding part on their custom clients was pretty fun. permalink fedilink source parent
[–] Venator@lemmy.nz 1 point 9 months ago Silver lining: maybe it could be used to make some games more accessible for people with disabilities permalink fedilink source parent