I say you are missing the fun.

I bought carbide studded tires for my bicycle, and rode all winter back and forth to work. -20C doesn't feel cold once you start peddling, and you actually have to unzip layers to cool off.

The summers at 35C were hot, but the sweat and moving through the air cool you.

Very invigorating feeling compared to being in a gym.