this post was submitted on 28 Jul 2024
218 points (98.7% liked)

technology

23303 readers
17 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 14 points 3 months ago (1 children)

Yeah but integrating LLMs with other systems is already happening.

Most recent case is out of Deepmind, where they managed to get silver medalist score in the International Mathematics Olympiad (IMO) using a LLM with a formal verification language (LEAN) and then using synthetic data and reinforcement learning. Although I think they had to manually formalize the problem before feeding it to the algorithm, and also it took several days to solve the problems (except for one that took minutes), so there's still a lot of space for improvement.

[–] [email protected] 9 points 3 months ago (1 children)

Sure, but you can do a lot more than that. You could combine LLMs as part of a bigger system of different kinds agents, each specializing in different things. Similarly to the way different parts of the brain focus on solving different types problems. Sort of along the lines of what this article is describing https://archive.ph/odeBU

[–] [email protected] 2 points 3 months ago (1 children)

It’s kind of like how graphics cards are used to optimize specific repeated computations but not used for general computation

[–] [email protected] 2 points 3 months ago

Good analogy, it's a tool for solving a fairly narrow problem in a particular domain.