74
The real energy use of agentic AI / Agents use about 600x more energy than simple AI prompts (www.theclimatebrink.com)
submitted 2 months ago by to c/fuck_ai@lemmy.world
6 comments fedilink hide all child comments
 

cross-posted from: https://slrpnk.net/post/41149756

you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 2 months ago (2 children)

It never gets beter eva, even some of these so called 'leftist' say they just don't like "corporate ai".... I use self hosted from time to time to remind me of how much of a waste of time it is. Just simple things it struggles to do. All this hype for nothing.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 0 points 2 months ago* (last edited 2 months ago) (1 child)

    99% of what you hear as being "AI" is just bullshit hype to mask the infrastructure for the mass surveillance state they are building.

    However, there are plenty of applications of AI that are actually less energy intensive than traditional computer simulations. This is in the realm of Engineering. Simulations of fluid dynamics for example.

    You're relationship with "AI" is very much LLM focused. LLMs are basically where all the money is going because it's where all the hype can be generated.

    We wouldn't be in an AI bubble if we were only using this field of computer science to build PINN based models for engineering and physics simulations.

    The area of computer science that gave you "AI" LLMs has existed for a long time and you've likely interacted with the models in some way without ever knowing it. Long before "AI" was in every search engine or infected the internet with AI generated images.

    If by "AI" you mean the power hungry LLM models. I agree. There are almost no applications for them where their benefits out-way their energy usage.

    But, the larger application of what computer science would call "Machine Learning" is not just these LLM models. And there is not really any reason to not call them "AI" at this point because they work on the same exact concepts. But, I was the one trying to explain to people that LLMs are not "AI" back in 2020. That word use to have actual meaning in computer science. I've lost that battle to capitalism and marketing though.

    So, in order to defend computer science I apparently have to defend "AI" now.

    The LLMs and their inflated usage placed into every single platform is definitely something I'd call "corporate AI" if I wanted to distinguish it from other good applications of machine learning. But, I'm a leftist and a CS grad.

    I have left the CS field after being laid off. The injection of "corporate AI" and the management forcing AI into everything does not make me want to return. Hopefully this bubble can pop and we can start learning from China with actual good application specific models again. The whole field of CS has been absolutely destroyed in progress by this LLM hyper-focus that corporations are forcing into everything.

    I hope that gives you a little more context for what other people may mean by "corporate AI". It's a plague of capitalism. No one with an understanding of the field thinks this is a good application of the technology. They are all just chasing investments and lying to do so.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 2 months ago

    I swear they marketed it in a way where previous technologies before LLMS get lumped in with everything else, just so they can say "well what about this life saving technology that runs at 7 watts on a raspberry pi" as if its the same thing. Its fusterating because in so many ways it derails a point because many people don't know enough to make a distinction. That and all the easy accessable local LLM's/ai diffusions are pretty much just heavily distilled/quantized versions of the main model, or just porn that still chug power. People aren't buying an obscure compute puck, building a server, or buying tensor hardware where you actually have to use Python or touch a terminal.

    I have struggled with a way to address this issue and the easiest way is to broadly just say fuck all ai and not make the distinction. The people who do use local models are maybe less than a single percentage of people who use ai. I don't think its nessisary to address it, and I think for most people everything you just typed is going to go in one ear and out the other. Even if you explain it to a random person on the street, I'm likely to believe they will still walk away thinking chatgpt is the just the natural evolution of the apple kicking camera, or algorithms that self tune a guitar.

  • permalink
  • fedilink
  • source
  • parent