Because infinite possibilities does not include impossible events.

Imagine an infinitely long track. We will pretend, for the moment, that this represents whatever makes you "you" and that the track doesnt end like literally everything in creation.

You were placed on it by a unique set of circumstances including time, place, and genetics, but you will never be able to leave the track. That would, metaphorically, represent a life event like you flapping your arms hard enough to fly. It simply will not happen, no matter how long you travel down the track, because you are bound by the limits of the track (physical reality)

You still have an infinite amount of area to explore. Just not outside of what is possible.