this post was submitted on 28 Jul 2024
218 points (98.7% liked)

technology

23303 readers
17 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 2 points 3 months ago* (last edited 3 months ago) (1 children)

We might eventually get to a point where LLMs are a useful conversational user interface for systems that are actually intrinsically useful, like expert systems, but it will still be hard to justify their energy cost for such a trivial benefit.

[โ€“] [email protected] 2 points 3 months ago

The costs of operation aren't intrinsic though. There is a lot of progress in bringing computational costs down already, and I imagine we'll see a lot more of that happening going forward. Here's one example of a new technique resulting in cost reductions of over 85% https://lmsys.org/blog/2024-07-01-routellm/