you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 8 hours ago

Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.

  • source
  • parent