Read the article. A MoE model distributed between multiple devices can function just very slowly. It doesn't need to translate Icelandic poetry just execute narrowly scoped actions it was specifically trained on.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments