you are viewing a single comment's thread
view the rest of the comments
[–] [S] 4 points 10 months ago

Yeah, I think so as well. In general, I'd argue that digital chips are a bad fit for LLMs in my opinion because the network works on gradients, and you're trying to use discrete digital transistors to encode them. It's just fundamentally inefficient. An analog chip can express gradients much cheaper and faster.

  • source
  • parent