I'm older than most here and I lead a mostly good life. I think the saying is mainly regarding death. In youth, you don't experience as much of it, but as you age, more and more people pass around you until it's you, alone.