788
US to probe Tesla's 'Full Self-Driving' system after pedestrian killed in low visibility conditions (apnews.com)
submitted 2 years ago by to c/technology@lemmy.world
191 comments fedilink hide all child comments
 

The U.S. government’s road safety agency is again investigating Tesla’s “Full Self-Driving” system, this time after getting reports of crashes in low-visibility conditions, including one that killed a pedestrian.

The National Highway Traffic Safety Administration says in documents that it opened the probe on Thursday with the company reporting four crashes after Teslas entered areas of low visibility, including sun glare, fog and airborne dust.

In addition to the pedestrian’s death, another crash involved an injury, the agency said.

Investigators will look into the ability of “Full Self-Driving” to “detect and respond appropriately to reduced roadway visibility conditions, and if so, the contributing circumstances for these crashes.”

you are viewing a single comment's thread
view the rest of the comments
[–] 24 points 2 years ago (26 children)

If anyone was somehow still thinking RoboTaxi is ever going to be a thing. Then no, it’s not, because of reasons like this.

  • permalink
  • fedilink
  • source
  • hideshow 26 child comments
    •
  • [–] 26 points 2 years ago (25 children)

    It doesn't have to not hit pedestrians. It just has to hit less pedestrians than the average human driver.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 25 child comments
    •
  • [–] 21 points 2 years ago (8 children)

    Exactly. The current rate is 80 deaths per day in the US alone. Even if we had self-driving cars proven to be 10 times safer than human drivers, we’d still see 8 news articles a day about people dying because of them. Taking this as 'proof' that they’re not safe is setting an impossible standard and effectively advocating for 30,000 yearly deaths, as if it’s somehow better to be killed by a human than by a robot.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [+] 9 points 2 years ago* (last edited 2 months ago) (4 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 7 points 2 years ago (3 children)

    If you get killed by a robot, you can at least die knowing your death was the logical option and not a result of drunk driving, road rage, poor vehicle maintenance, panic, or any other of the dozens of ways humans are bad at decision-making.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 2 years ago*

    "10 times safer than human drivers", (except during specific visually difficult conditions which we knowingly can prevent but won't because it's 10 times safer than human drivers). In software, if we have replicable conditions that cause the program to fail, we fix those, even though the bug probably won't kill anyone.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 2 years ago

    The problem with this way of thinking is that there are solutions to eliminate accidents even without eliminating self-driving cars. By dismissing the concern you are saying nothing more than it isn't worth exploring the kinds of improvements that will save lives.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 0 points 2 years ago

    But they aren't and likely never will be.

    And how are we to correct for lack of safety then? With human drivers you obvious discourage dangerous driving through punishment. Who do you punish in a self driving car?

  • permalink
  • fedilink
  • source
  • parent
  • [–] 13 points 2 years ago (11 children)

    It needs to be way way better than ‘better than average’ if it’s ever going to be accepted by regulators and the public. Without better sensors I don’t believe it will ever make it. Waymo had the right idea here if you ask me.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 11 child comments
    •
  • [–] 1 point 2 years ago (10 children)

    But why is that the standard? Shouldn't "equivalent to average" be the standard? Because if self-driving cars can be at least as safe as a human, they can be improved to be much safer, whereas humans won't improve.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 10 child comments
    •
  • [–] 3 points 2 years ago (7 children)

    I'd accept that if the makers of the self-driving cars can be tried for vehicular manslaughter the same way a human would be. Humans carry civil and criminal liability, and at the moment, the companies that produce these things only have nominal civil liability. If Musk can go to prison for his self-driving cars killing people the same way a regular driver would, I'd be willing to lower the standard.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 6 points 2 years ago (6 children)

    Sure, but humans are only criminally liable if they fail the "reasonable person" standard (i.e. a "reasonable person" would have swerved out of the way, but you were distracted, therefore criminal negligence). So the court would need to prove that the makers of the self-driving system failed the "reasonable person" standard (i.e. a "reasonable person" would have done more testing in more scenarios before selling this product).

    So yeah, I agree that we should make certain positions within companies criminally liable for criminal actions, including negligence.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 4 points 2 years ago (5 children)

    I think the threshold for proving the "reasonable person" standard for companies should be extremely low. They are a complex organization that is supposed to have internal checks and reviews, so it should be very difficult for them to squirm out of liability. The C-suite should be first on the list for criminal liability so that they have a vested interest in ensuring that their products are actually safe.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 3 points 2 years ago (4 children)

    Sure, the "reasonable person" would be a competitor who generally follows standard operating procedures. If they're lagging behind the industry in safety or something, that's evidence of criminal negligence.

    And yes, the C-suite should absolutely be the first to look at, but the problem could very well come from someone in the middle trying to make their department look better than it is and lying to the C-suites. C-suites have a fiduciary responsibility to the shareholders, whereas their reports don't, so they can have very different motivations.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 2 years ago (3 children)

    The c-suites have the ultimate power and therefore ultimate responsibility for whatever happens in their organization. Similar to how parents can be held criminally liable for their children's actions. It's just that much more incentive for them to make sure things are in order in their organization.

    Also, Citizen's United ruled that corporations are people, so they can be held to the same standards of responsibility as other people.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 2 years ago (2 children)

    parents can be held criminally liable for their children’s actions

    It's a pretty limited liability, as can be seen in a lot of incidents (e.g. mass shootings). You have to prove a pretty high standard of negligence for a parent to be responsible for their kids' actions.

    The same should be true for anyone else as well, if the C-suite is unaware that something negligent or illegal was going on two levels below, they shouldn't be held liable for that. You should only be liable for a crime that you are aware of, or should have been aware of if you were doing your due diligence. But yes, in many cases, the C-suites should be held to task here.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    That's the thing though...I think it is part of their due diligence to know what's going on in their own business. If they can't guarantee that it's safe, they shouldn't release it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 years ago

    If their reports are lying to them, and not in a way that they should have detected, then I don't think it falls on them if things go sideways. And that happens somewhat regularly, when you have a VP or something somewhere painting a much rosier picture that what is actually happening on the ground.

    At that point, it comes down to a call on whether they were negligent.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 5 points 2 years ago*

    That is the minimal outcomes for an automated safety feature to be an improvement over human drivers.

    But if everyone else is using something you refused to that would have likely avoided someone's death, while misnaming you feature to mislead customers, then you are in legal trouble.

    When it comes to automation you need to be far better than humans because there will be a higher level of scrutiny. Kind of like how planes are massively safer than driving on average, but any incident where someone could have died gets a massive amount of attention.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 2 years ago*

    It's bit reductive to put it in terms of a binary choice between an average human driver and full AI driver. I'd argue it has to hit less pedestrians than a human driver with the full suite of driver assists currently available to be viable.

    Self-driving is purely a convenience factor for personal vehicles and purely an economic factor for taxis and other commercial use. If a human driver assisted by all of the sensing and AI tools available is the safest option, that should be the de facto standard.

  • permalink
  • fedilink
  • source
  • parent