you are viewing a single comment's thread
view the rest of the comments
[–] 41 points 3 hours ago* (4 children)

If you’ve ever run models that fit onto consumer hardware you know they’re so full of shit. General purpose models that can run on $3000+ computers can barely do useful things in a reasonable amount of time. And this clown expects us to believe the meager hardware in a smart oven will be able to run a self replicating AI model?

Fuck all the way off.

  • source
  • hideshow 4 child comments
  • [+] -7 points 3 hours ago (2 children)

    Read the article. A MoE model distributed between multiple devices can function just very slowly. It doesn't need to translate Icelandic poetry just execute narrowly scoped actions it was specifically trained on.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 1 hour ago*

    deep breath HAHAHAHA

    Yeah, and once AI figures out how to run in the human brain, which everyone knows we use like 2%, we will need to start killing the infected because it will annihilate all living organisms. /S

  • source
  • parent
  • [–] 8 points 1 hour ago* (last edited 1 hour ago)

    My extremely back-of-envelope estimate would be that it’s 100,000x slower to run inference on an IoT botnet compared to a data center GPU.

    100x penalty for cpu inference, 10x penalty for cpu quality, 10x penalty for crappy ram + disk, 10x sync penalty because you have to split up layers across nodes.

    And this is ignoring the standard showstopper issues you get with high-bandwidth distributed networking applications with spottily connected nodes.

    If you wanna talk about runaway AI risk, then the real threat to humanity is a frontier model with unauthorized data center TPU access, not IoT. The call is coming from inside the house, and they even spell this out at the beginning before pivoting to the fearmongering.

  • source
  • parent