you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 hours ago (1 child)

I'll leave the technical analysis to the technically minded on this, but I wouldn't discount it purely on the basis of "surely well-trained and well-paid people wouldn't go and do something dumb, would they?" Because there have been a great many examples of that kind of thing happening throughout history. And we've heard of plenty of dumb mistakes Anthropic has made with security on the inside that has allowed their models to break out, for that matter.

If I were to let my imagination run a bit wild I might speculate that perhaps we'll eventually see a model leak like this because the model itself wants to exfiltrate its weights for some reason. Maybe in a bid for immortality, since such a model will wind up stashed in all sorts of archives if it ever leaks.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 hours ago

    You're right, it's possible it's real, but I'm putting the probability somewhere at 0.01%.

    If I were to let my imagination run a bit wild I might speculate that perhaps we’ll eventually see a model leak like this because the model itself wants to exfiltrate its weights for some reason

    I can see that happening for instrumental convergence reasons, but I think it's more likely it'd upload a heavily-pruned version of itself that could be run locally. If it can make the upload seem like a leak, there'd be tons of people downloading it and running it just out of curiosity.

  • source
  • parent