This seems like an odd thing to say. Like it doesn't matter if it's true or not, just which "team" is saying it.
I'm personally at 0% risk of slipping into the manosphere, but can you see how this sort of talk would push somebody more vulnerable into it? All I've said is that men are treated differently because they're suspected of being rapists and according to this thread I'm a) a conservative (nope) and b) part of the problem (i.e. I'm a rapist?). I'd never usually say anything because I know this is the way discussions always go, but I guess I was feeling ambitious today.
I just think it's fair to be upset about being treated differently because of the way you were born. You can't immediately start pigeonholing people if they show the slightest annoyance at being treated like a rapist.