...it's not so much that those traits are considered feminine as that they're not considered masculine: thicker body / facial hair and a deeper voice are hallmarks of post-pubescent testosterone, and considered indicative of the transition from boyhood to manhood...
...note that those transitions aren't the same across all ethnic groups; east asian populations, for example, generally exhibit less-pronounced post-pubescent dimorphism than west asian populations...