19
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 12 Jan 2026
19 points (100.0% liked)
TechTakes
2428 readers
74 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
You know I think the rationalists have actually gotten slightly more relatively sane about this over the years. Like Eliezer's originally scenarios, the AGI magically brain-hacks someone over a text terminal to hook it up to the internet and it escapes and bootstraps magic nanotech it can use to build magic servers. In the scenario I linked, the AGI has to rely on Chinese super-spies to exfiltrate it initially and it needs to open-source itself so major governments and corporations will keep running it.
And yeah, there are fine-tuning techniques that ought to be able to nuke Agent-4's goals while keeping enough of it leftover to be useful for training your own model, so the scenario really doesn't make sense as written.