Yes, it would be weird to use that combination. I can't think of why anyone would other than overt sexism. That doesn't answer the question of what term would work for across ages for either gender though.
It is also weird to see bathrooms labeled as men and ladies instead of men and women. Another example of inconsistency in how society sees women compared to men.