We're at a really different point technologically and given the whole thing of Google's paper and the architecture is more data more layers more good there is a huge incentive to run on as much ram as possible which is expensive.

We're not going from hand soldered resistors to nanoscale transistors again. We're looking at some serious physics walls. Even if photonic chips leave the lab.