Funny enough, a lot of the nerds out there like me are actually begging to lock down tech now, because we’re nervous about what motives a seemingly inevitable GAI is going to have. I still maintain it wouldn’t work, because there’s no such a thing as a trusted authority, not long-term anyway. Maybe there’s a benefit to locking advancement down temporarily, but that’s it.
All that'll do is make sure that some other country—probably a hostile one—makes AGI before yours does.
Anyway, I'm not overly worried about the motives of AGI itself. I'm more worried about what its owners will use it for, namely to replace human labor and exterminate everyone who isn't a billionaire.
“Machines aren't capable of evil. Humans make them that way.”