But if you have a 3% chance of being attacked by a man, doesn’t that also mean that since you have a 1.5% chance of being attacked by any human?

That’s not how statistics work, at all.

Men are far more likely to rape or assault women than women are to assault men.

Keep in mind another aspect is that your average man is bigger and stronger than your average women as well.