I was in favor of unisex bathrooms, but someone pointed out that women are constantly harassed by men and the only safe way to escape unwanted attention is to retreat to a place that men basically cannot enter.
That is, it can be unsafe for a woman to tell a man to leave her alone, or that she's not interested, or similar. She can go to the bathroom though.