While I don't think what you said is wrong (though I have some semantic disagreements; I don't think men are privileged but do think that women are disprivileged), I don't think it's that relevant. Power dynamics are far more complex than what you're describing. While you can conclude that women on average have less power than men on average, that doesn't mean there aren't a huge amount of men subordinate to other men, women subordinate to other women, or men subordinate to women. In all of those cases, some higher figure is abusing their power, whether it's by SA, violence, manipulation, or especially not holding someone else accountable.

The way I see it is that by making blanket statements implying that men are the problem, you're distracting yourself from the root problem while alienating a good chunk of people who would support your cause, including male SA victims. It (anecdotally) seems like the pool of vocal SA victims is in actuality limited to just women who have been assaulted by a man. That division seems unnecessary. It's the same way of thinking that alienates women who have Autism or adults who have ADHD; people only talk about the biggest or most substantial sub-group rather than the group as a whole.