you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 5 months ago (1 child)

I think their point is that regular web browsing will use less power than web browsing with local LLM calls. Your PC running an LLM is likely gonna hit its TDP limits, while browsing will be a fraction of that. Yes it’s less power than used by a trillion parameter model but I think their point is it’s vastly more than your non-LLM standard browsing would be

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 5 months ago

    Your PC running an LLM is likely gonna hit its TDP limits

    Debatable for a 4GB model, depending on the hardware. It's also (most likely) not constantly running, so while yes, it will use more power than not having it, whether or not it is a significant change in the long run depends on many factors.


  • source
  • parent