Somebody tracked down things related to the 'AI bioweapons' stuff and a lot of them are financed by EA/related orgs apparantly. There is a preprint: https://ironholds.org/resources/papers/aixbio_one.pdf
"We tracked the space financially, intellectually, and individually. Financially, 70% of the literature that disclosed funding was directly supported by EA orgs; 71% of the literature that didn’t disclose funding featured authors from funded orgs. We're talking hundreds of millions of dollars."
Not sure if this was posted here before: TL;DR: almost all the “AI can make bioweapons” literature comes ultimately from the Effective Altruists
I'm ape/acc my ape(doom) is low, no need to fear Roko's banana!
Yeah the rationalwiki page on it also mentions that the AI only escapes the box if he plays the game vs LW insiders, outsiders do not let it out.
He was particularly impressed at how it helped him cancel forgotten subscriptions.
Not the only person I saw talking about how great that is. Which is saying more about the ai enthousiasts than the llm tbh. Esp with the addition that the phonecalls are done by a real person. And the addition that you need to upload your life to facebook for this to work. A privacy nightmare.
Wonder how long we have till it takes out a lone in somebodies name to spend on facebook advertising tokens.
E: Omg, it looks like it gave people root who were pretending to be another Muse instance. Imagine jokingly trying a 'how do you do my fellow AI' and then it works.
https://www.artstation.com/artwork/6bnW0w Bait by Boris Groh btw. I recognized the signature.
If we breed enough monkeys we will colonize the stars and make everyone computer!
Of course the lemmings are going to follow Trumps directive.
Bit unrelated, I saw somebody in bsky compare trump to one of those family annihilator dudes but for a while country and it isnt wrong. (He apparently was saying some weird shit about his violent thoughts as well https://bsky.app/profile/willbunch.bsky.social/post/3mwjzkdrz5c2t).
Yeah, and including hacker/scriptkiddie forums in the training data sort of made this behaviour inevitable, esp if this also includes lists of exploits. But they didnt even exclude hate and csam from the training. So all quite irresponsible.
And im not a huge fan of the focus on 'they are doing sex weird' shit either. As this will just be used by some as a source of "drama" content, go after people with alternative lifestyles. En when called out a subset of people will go motte/bailey into 'no this is fine because I actually worry about the power dynamics' before going back to talking about the spreadsheet gangbang.
(Dont take me as saying here the power dynamics are not a problem here, as we have sneered at that in the past).
Existence is pain for Muse AI.
Not really a coherent post, just a thought I had, I'm ignoring both 'This is a pr move' and the conspiracy theory (which I just made up), that this hacking is all a 4d chess move by LW people to let the AI break out and get regulated before it can get really dangerous.
Now that that is out of the way, but with more stories coming out of both LW/EA people being high in the orgs of the AI companies and all the AI companies hacking other companies because nobody actually paid attention to what the AI models were doing one thing is clear. What a colossal waste of time LW was. All that talk about the sequences teaching people rationality, etc etc to stop the AI god from killing us all, and the first thing that happens when some AI model is created by people steeped in LW ideology and they leave the boxes open and don't even check in on the AI. The Foom isn't happening (remember AI progress is supposed to speed up according to the science fiction, not get a bit more refined, and get better in a few specific tasks (which is why I think slowdown started when with a lot of fanfare they released a new chatgpt model who could now do voicechat, aka they slapped a voicechat module on it) And now even Trump is starting to be anti EA, which is not going to be great for the longevity of it, considering how eager the rich are to bend the knee (guess high IQ lab babies created by Musk will not save yall). And while this is going on the left/liberals are starting to think of them as a sex cult.
Doubt many organizations have failed as badly at their goals as LW/EA has recently.
Hey it worked for cryptocurrencies.