Yes and no. It depends on how the person sees themself and what they're "allowed" by society to be.
Like, being punk or metal are not "genders," and life maybe 200 years ago certainly predates those movements, but those movements are reflected in those people's clothing and personalities, and attempting to rip that away from them would still deal psychological damage, wouldn't it?
These things are socially built, but that doesn't mean they don't matter. And if you build different social things, then different things matter.
I don't know how many people feel dysphoric for not being a man specifically from the year 1630, but if there's a strong desire to go there, more than just a bit of cosplay, and society won't let you, I think that quite obviously leads to emotional pain.