Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments