Yeah I just don’t buy that there is a case where any “net gain” here is justified. These are people’s lives that you’re playing with by reducing them to what amounts to a balance sheet in the name of saving money.

The idea that you would create the possibility of denying someone emergency care that didn’t exist before, no matter how improbable (probably not even that improbable, given the propensity even the most advanced frontier AI models have for getting things wrong or hallucinating entirely despite simple instructions) just to save 10-15 seconds on average for other callers is not only absurd on its face, but morally bankrupt. You can personally ignore it because you don’t live there and it’s not the lives of you or your family at stake. I think those who this system could fail would not be able to ignore a flaw like that when it happens to them, and the idea that their peril was “highly improbable” will not be of much comfort to them.

The problem is that there are staffing shortages. The solution is hiring more staff. Trying to cheat our way out by implementing a system prone to unmitigatable flaws that could have life-altering or even life ending consequences isn’t a solution, it’s dystopian.