Right, but that's precisely the problem. We don't need to be going around fearmongering about how dangerous AI itself is. We need to be regulating it and fining the actual people who are making decisions to use AI in ways that result in harm. Whether that harm is direct human injury, injury through negligence (like denying a health insurance claim that should have been approved), financial injury, reputational, whatever.
They need to be held accountable exactly the same as if a human had done it. Humans have been driven to suicide by the criminal response to hacking for far more noble a reason than "cheat on an AI evaluation test". The weight of the law should be brought down on the executives responsible for the Hugging Face hack, too. But fearmongering about how this shows how amazeballs advanced the AI has become doesn't accomplish that.