For me, i felt like that also when I was 35. I didnt want my family to be in my life since I didnt feel good around them.

Now at 50, I have again connected to some of them. Because you get back to those feelings that life is not endless and you start to think about that you will one day not be here anymore. And its nicer if that happens when you have made peace with at least some of those people.

Tldr, age made me think different at different stages. Maybe it happens for others as well. :)

It changes one kind of stress for another in a lot of cases. If you annoy everyone you come into contact with, you end up alone, which isn't great for your mental health, and turns every interaction into an annoyance, so you end up stressed by the necessity of interacting with people you don't want to interact with. There is no escape from humanity when you are human.