Due to the sheer size of space, this is most likely to have happened to stars closer to us (same thing as parallax effect, the same speed / moved distance moves something close more angular degrees across the sky)