Frankly this is one of those things I kinda hope self-driving cars will help fix, given that we’ll just never have decent public transport.
Over 65? Here’s a test every year. Can’t drive to a high standard? Licence invalidated, go get yourself a car that drives itself, which at this point should be going for a comparable price.