Aside from men being horny in the 1800s, and this being a holdover since that time, is there any actual reason why this hasn't changed?

If society was dominated by women, would this be more likely to change?

I was sweating my ass off hiking in the hot sun, and the question has been bothering me all day after my top soaked through with sweat.