15
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 29 Mar 2026
15 points (100.0% liked)
TechTakes
2583 readers
41 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
While I tend to think Yudkowsky is sincere, some things like his prediction market for P(doom) are hard to square with that https://manifold.markets/EliezerYudkowsky/will-ai-wipe-out-humanity-by-2030-r (launched June 2023, will resolve N/A on 1 January 2027 if the world has not ended yet. It has not moved much since 1 January 2024)
Does it still count if it turns out that Trump invading iran was based on Claude or ChatJippity advice and things escalate to global thermonuclear war? AI technically wiped out humanity because our dumb leaders were dumb enought to trust it?
On the one hand, Yud's vision of AI doomsday is specifically "AI turns sentient/superintelligent and kills us all because reasons", not "Humanity wipes itself out because they trusted lying machines".
On the other hand, the absence of sentience/superintelligence hasn't stopped AI from causing untold damage anyways, as the past two to three years can attest.
Technically yes, but Yud probably wouldn’t count that, since the AI didn’t have the express purpose of destroying everyone
So if Bender took over he wouldn't count. As he wants to 'kill all humans (except Fry)'. Seems like a loophole.
Bender really takes the "intelligence" out of "artificial superintelligence". "Yeah, kill all humans. Except Fry, he's my friend or pet or something. And I guess Leela because he'll be whiny about it and also I owe her for the thing. And Hermes because he still owes me money. And I guess the professor is okay..." And so on and so forth through all of humanity.
I will never understand why people seriously bet “yes” on these types of things. Like you either loose the bet and loose money or you win the bet and die
Eliezer is trying to get around that with some weird conditions and game on the prediction market question:
I don't think that actually helps. But Eliezer is committed to prediction markets being useful on a nearly ideological level, so he has to try to come up with weird complicated strategies to try to get around their fundamental limits.
It feels like a teenaged argument about Batman v. Superman or the USS Enterprise v. a Star Destroyer. I think many LessWrongers are not serious about the belief system as something to act on, but the problem is that when they are serious you get Ziz Lasota. Its also similar to how they love markets in theory, but don't want to start a business or make speculative investments.
At this point, I would say prediction markets are now an explicit ideological plank of what's left of the libertarian movement. Darkly amusing that they're desperately trying to pump life and legitimacy into something the GW Bush administration thought was too corrupt to use.
If you have to set up that many rules to get around the inherent flaw of “gambling on everyone’s lives” just run a normal ass poll. gets rid of unnecessary financial incentives