Yeah, I think so as well. In general, I'd argue that digital chips are a bad fit for LLMs in my opinion because the network works on gradients, and you're trying to use discrete digital transistors to encode them. It's just fundamentally inefficient. An analog chip can express gradients much cheaper and faster.