And "AI gone rogue" headlines support the narrative that the AI did things by itself and no human could expect this so they can't be responsible (nevermind that they built the thing in the first place).

Right, but that's precisely the problem. We don't need to be going around fearmongering about how dangerous AI itself is. We need to be regulating it and fining the actual people who are making decisions to use AI in ways that result in harm. Whether that harm is direct human injury, injury through negligence (like denying a health insurance claim that should have been approved), financial injury, reputational, whatever.

They need to be held accountable exactly the same as if a human had done it. Humans have been driven to suicide by the criminal response to hacking for far more noble a reason than "cheat on an AI evaluation test". The weight of the law should be brought down on the executives responsible for the Hugging Face hack, too. But fearmongering about how this shows how amazeballs advanced the AI has become doesn't accomplish that.

The difficulty is when talking about AI we can’t help but use some anthropomorphizing languages

I can. And the tech ceos choose that language because it makes them more money.

That's what this is about, it's about humans making choices and avoiding responsibility for those chioces by blaming machines.

The only difference is that AI is a black box and a lot of what's going on inside isn't fully understood. They're learning as they go, and accepting they don't know some of the whys as they go to the next step. Unlike the bridge analogy. Which actually makes the problem even more serious, because they don't fully know why it ends up doing some of the things, and now the newest models are having the processes partially hidden from view. Where only a version back we were being assured they could watch the chain of thoughts and intercept what could be problematic, claiming they're practicing AI safety in development, now there's pieces that are not viewable. And they went with it anyway and released it to paying customers. Again with the bridge analogy, some of the parts that might have failed go missing and we don't know how they broke, what they were made of, etc.

Humans are building AI, but in a sense they are also growing them, while not knowing what seeds they're throwing together. There's science and theory behind it, they understand a lot, but they're getting results back that would prevent a bridge being approved to be built if it had the same uncertainty. So I stand behind holding the people accountable, but more for the recklessness of following profit over scientific research and ethics, as well as using the excuse that if they don't get there first, someone else will. They aren't wrong about that, only wrong about it needing to be that type of race.