you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 12 hours ago (4 children)

If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use.

Hm, I don't see the harm in powering local models with solar.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 8 hours ago

    Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.

  • source
  • parent
  • [–] 2 points 11 hours ago (2 children)

    Depends. Is it solar energy that started production to power these models? Great! If not, then you're still consuming power and the difference will have to be made somewhere, likely by burning more fossil fuels.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 10 hours ago (1 child)

    Oh yeah, I mean my own personal solar modules in my backyard. I agree it's not that easy to say "solar exists, checkmate doubters", that would be silly.

  • source
  • parent
  • hideshow 1 child comment