Why are you taking offense to someone saying your lifestyle sounds terrible to them? They're not saying you must be unhappy, just that they don't want to live that way.
I don't want kids, and I'm sure those with kids that they wanted are very happy, and I'm glad there are people for whom that is a happy life because it wouldn't be to me.
Gotta edit my comment to say I was totally being autistic and completely missed your joke on the first pass, my bad!