Nah, but I should be able to just keep to myself and not have a conversation without being treated like a predator for it.
Oh no! Society is judging you unfairly because of your outward appearance? Gee, that almost sounds like the flip side of what the women are complaining about. Sucks, don't it?
The answer should be “don’t treat people like shit without knowing them.” That should be the answer.
That's not going to work until everybody does it, which means the real answer is "actively work to stop other people from treating people like shit," and even more specifically, "understand who the aggressors and victims are so you don't make the problem worse by attacking people who are just trying to defend themselves."