1589
Black Mirror AI (mander.xyz)
submitted 1 year ago by to c/science_memes@mander.xyz
206 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 1 year ago (3 children)

Asking ChatGPT a question doesn't take 1 hour like most of these... this is a very misleading graph

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 5 points 1 year ago* (2 children)

    This is actually misleading in the other direction: ChatGPT is a particularly intensive model. You can run a GPT-4o class model on a consumer mid to high end GPU which would then use something in the ballpark of gaming in terms of environmental impact.

    You can also run a cluster of 3090s or 4090s to train the model, which is what people do actually, in which case it's still in the same range as gaming. (And more productive than 8 hours of WoW grind while chugging a warmed up Nutella glass as a drink).

    Models like Google's Gemma (NOT Gemini these are two completely different things) are insanely power efficient.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 1 year ago* (1 child)

    I didn't even say which direction it was misleading, it's just not really a valid comparison to compare a single invocation of an LLM with an unrelated continuous task.

    You're comparing Volume of Water with Flow Rate. Or if this was power, you'd be comparing Energy (Joules or kWh) with Power (Watts)

    Maybe comparing asking ChatGPT a question to doing a Google search (before their AI results) would actually make sense. I'd also dispute those "downloading a file" and other bandwidth related numbers. Network transfers are insanely optimized at this point.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 1 year ago

    I can't really provide any further insight without finding the damn paper again (academia is cooked) but Inference is famously low-cost, this is basically "average user damage to the environment" comparison, so for example if a user chats with ChatGPT they gobble less water comparatively than downloading 4K porn (at least according to this particular paper)

    As with any science, statistics are varied and to actually analyze this with rigor we'd need to sit down and really go down deep and hard on the data. Which is more than I intended when I made a passing comment lol

  • permalink
  • fedilink
  • source
  • parent