I am decidedly on the spectrum and very much prefer things to be clear-cur with precisely defined lines.

You can be a healthy individual with solid beliefs and that is precisely why you can't in good conscience walk away from your family who might be struggling but always means well in their heart of hearts. Not bad people, just misguided. And on top of that, they're your only support network. You may disagree on everything except that you genuinely love one another and would never wish or bring harm upon one another.

A healthy person would absolutely struggle with leaving that social circle. And this isn't really that far-fetched a scenario as most people really aren't that adamant and vitriolic in their beliefs as any given extreme would have you believe.

So are you wrong? Not in every case, for sure. But you're also not really correct either. Human interactions are mostly nuance, which your assessment is entirely devoid of.