you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 22 hours ago (1 child)

Sorry, ignorant question from someone who didn't understand much of your comment - do you mean that AI models are writing code that improves them? Cos that would be interesting.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 21 hours ago

    Not improvements to the AI themselves, but rather the software that runs them. Backends like Unsloth are typically generalists - they are compatible with all sorts of hardware, but in exchange, they don't incorporate the latest improvements or ideas. Projects run by pure human implementation tend to require a lot of oversight to ensure that additions don't break functionality.

    AI is really good at collecting and aggregating information. This makes them ideal for creating tailor-made products that have a narrow focus, since they raid many Githubs and papers, then attempt to make them into a product. Strata is one such backend, which is specially designed for Qwen Next-Flash.

    Strata runs much faster than Unsloth and other generalist backends, but lacks flexibility in what it is suited for.


    At least, that is my admittedly basic understanding of the situation...

  • source
  • parent