193
Western open-weight models still can’t beat China: Chinese open-weight AI models offer high capability at significantly lower costs than U.S. frontier systems. (restofworld.org)
submitted 2 days ago by to c/technology@lemmy.world
50 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] -2 points 2 days ago (1 child)

Training these models still requires massive data centers, and using any of them that at all compare to frontier models for inference requires large numbers of GPUs

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 2 days ago

    It does for now, but the methods for modifying an LLM are getting increasingly sophisticated. From blending models to doing brain surgery on them to fine tune the weights, there's a lot of new techniques being developed all the time

    There's also recently been a breakthrough that cut the ram requirement to 1/6, eventually someone is going to figure out how to train models orderes of magnitude more efficiently

    Especially once the AI bubble pops and no one is willing to dump billions into constant iterations

  • permalink
  • fedilink
  • source
  • parent