xkcd

You are completely correct. The "happy path" or what to do if everything goes right is fairly straightforward for autonomous cars. It's when it gets into exceptions or unexpected scenarios like this that it becomes a problem. It's a car so you can't just stop it in the middle of the road, but you cant tell it to ignore road signs either