63
DeepSeek to order 160000 Huawei AI chips over Nvidia (www.huaweicentral.com)
submitted 4 days ago by to c/technology@lemmy.ml
12 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 days ago (2 children)

Yes but no. Asics are very inflexible and have a hard time dealing with new functions. GPU's are general purpose and therefore new types of convolutions are much easier to implement and have the driver support for it.

There are frequent claims of random companies making NPU's TPU's etc but they always have software issues for training new models with the latest methods. If not Nvidia wouldn't be having such massive market share anymore.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 4 days ago (1 child)

    If deepseek bought those chips only for inference, they wouldn't be able to keep up in model development and wouldn't need inference anymore.

    As Meituan uses these chips for training, Deepseek will also use these chips for training. You claiming the chips are somehow defective won't make Deepseek not use them.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 days ago

    Different chips can be used for training but as I said it's driver hell and much easier to just use Nvidia. As time goes on different vendors are catching up to Nvidia but I still think they're having a hard time with it. Chinese companies aren't still buying Nvidia because they love paying ludicrous rates for a tiny bit of extra VRAM on a GPU chip that's basically the same as the gaming one.

  • permalink
  • fedilink
  • source
  • parent