At least in Doctor Who, the T.A.R.D.I.S. can teleport through space as well as through time, solving that problem. But most time machines don't