I'm borderline obsessive about it personally. Like after bathroom, right before eating, and right after some gardening. And it is fucking disgusting how many dudes I witness in public restrooms walk straight out. I used to call them out, but it's not worth the hassle anymore.
But from a purely subjective pov, never touch another dude's hands because odds are they haven't washed them in days.