I don't think that perception holds particularly true past your formative years. For all the usual feeling of time flying, my 30s don't seem to be going faster than my 20s.

Maybe when I get a good midlife crisis I'll change my mind, but at least I'll have a sick tattoo and a Porsche