I think there are physical and economic limits. Neural networks may improve in software, but they still need more and more hardware, at some point that hardware resource curve is going to be to steep to climb at the current rate.
It's true, but think like the crypto miner bugs. I don't know enough on AI's working, but is a distributed computing LLM possible, or is the need for super close super low latency between nodes eliminate the risk of a distributed computing, learn as it travels botnet powered AI worm, that continues evolving even if it's home is shut down.