Whether or not someone has a passport is almost entirely based on the amount of wealth that person or their family has.

Where I grew up, almost nobody traveled abroad because nobody could afford it. Or at most, back in the day they would drive to Canada because you could cross without a passport.