100
Iran is weeks away from a nuclear weapon vibes (www.anthropic.com)
submitted 13 hours ago by to c/programmer_humor@programming.dev
18 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 10 hours ago (8 children)

This is scary if true. Imagine someone installing such model to some smart TV in some relaxation break room of a nuclear facility.

  • permalink
  • fedilink
  • source
  • hideshow 8 child comments
    •
  • [–] 3 points 9 hours ago (5 children)

    Meh needs data center to run , unplug it and problem is gone

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 8 points 9 hours ago (4 children)

    That’s the thing: it doesn’t need a data center. These are small local LLM distilled on cyber attack scenarios. They’re trained to lay low and copy itself to other devices in the network.

    Once the breach has been detected, it’s already too late to unplug - they’re everywhere.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 10 points 8 hours ago* (last edited 8 hours ago) (3 children)

    Except small local LLMs probably aren't good enough to carry autonomous tasks correctly (even stuff like Haiku 4.8 from Anthropic makes mistakes quite often) and good luck getting something the size of Opus working in a soda machine. They may not even be able to lay low correctly. But then again these companies have internal models which are atleast couple generations ahead of what is publicly available so maybe they have more efficient smaller ones too? I somehow find it hard to believe but I guess we will see.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 1 hour ago

    They are bleeding resources so bad they wouldn't wait to put those efficient models in play. Every better model requires more and more resources.

    You are on the money about the models not being good enough, let alone a harness. This whole worry is a nothing burger. Nobody outside of these labs has terabytes of RAM to run a model anywhere near a level of concern, let alone somehow distribute it across IoT devices or something. Anyone who has run a model locally knows how woeful a small model's abilities are.

    This is just more Rationalist cult hand wringing. They believe they are building a digital god, so of course they are dreaming all of this nonsense up.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 6 points 5 hours ago* (1 child)

    But then again these companies have internal models which are atleast couple generations ahead of what is publicly available

    But do they actually? The release cycle and also how often there were obvious flaws in the releases suggest that they are all fighting aggressively for market shares and release every new perceived improvement as it comes to try to stay on top.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 4 hours ago

    The math problems they have been solving lately suggests that they do. But then again they throw thousands of agents at the problems to get them solved so I don't know how much if it is a number thing and how much is a model thing.

  • permalink
  • fedilink
  • source
  • parent