IMO the worst thing about being a virgin is that it's forbidden to have sex, at least according to your caring parents, teachers, and social context. It's more about breaking the nonsensical rules than actually about having sex, at least that's how it was for me.