That is all true, as long as you're not using it to justify a moral position. Those are all facts. Well... Not the "social contract" phrase. That's a term of art based on an analogy. But you're salient point is absolutely a fact, and correct. We do agree on that.
But again, it says nothing against the concept I'm trying to promote and argue here. The most moral way to handle a bigot is with compassion, rather then more hatred.