I've had this same thought. Like, if I ever had the opportunity to be as rich as Bezos or Musk, I don't think I'd make it because I would've stopped so much earlier.
At a certain point, I'd just think "Sweet, we're set for life, and I can spend all my time with my wife and kids." Why would I sacrifice that kind of life just to see numbers on my bank accounts go up in a way that no longer meaningfully affects us?