Driving involves a lot of soft decisions. Any action can be risky, even a regular lane change. But we still do lane changes all the time. Ultimately it's up to us to judge.
Point is, I think there are cases where making a last minute lane change can be totally safe, eg if the cars in the other lane are already stopped.