That's a perfectly reasonable position, the question of how complex a human brain is compared with the largest NNs is hard to answer but I think we can agree it's a big gap. I happen to think we'll get to AGI before we get to human brain complexity, parameter wise, but we'll probably also need at least a couple architectural paradigms on top of transformers to compose one. Regardless, we don't need to achieve AGI or even approach it for these things to become a lot more dangerous, and we have seen nothing but accelerating capability gains for more than a decade. I'm very strongly of the opinion that this trend will continue for at least another decade, there's are just so many promising but unexplored avenues for progress. The lowest of the low hanging fruit has been, while lacking in nutrients, so delicious that we haven't bothered to do much climbing.