Yes! I went kind of hard into technical Minecraft during COVID and used it a lot. It's more of an automation framework, it's a terrific piece of software but not "AI".

I've dicked around with a baritone+LLM setup but it's really hard to get the model to do anything worthwhile. The model doesn't really see the world around it, just whatever textual representation you manage to make of it. It's slow and frustrating and only gets the very basic tasks right.

I would imagine a vision+interaction model would be leaps and bounds better at any interesting application. Ultimately I'd love to see a civilization of bots building its own base with mega farms and shit...