Uh, how often are you using the Internet to connect to a computer in your home town? Maybe 5% of the time?
I've never used Starlink, but with a basic understanding of geography and optics, I'm going to bet that in most scenarios the latency difference between Starlink and fiber is negligible, sometimes even being faster on Starlink, depending on the situation.
That said, I'm not suggesting Starlink is a realistic replacement for fiber, just that latency isn't the big issue. (It has other serious issues)