Not to be overly morbid, but what's the point in saving up for retirement if the job is killing you? Financial security is important, but so is your mental health. And based on your general field, I don't think I need to explain that stress has real, quantifiable consequences. I wouldn't be surprised if reducing your stress level actually raises your ability to do some stuff for yourself that you're currently finding pretty impossible. Less stress at work might give you more energy to exercise, cook healthy meals, better maintain your home, etc.
You might need to adjust some of your "extra" spending to make it work, but if that's the only real sacrifice in the switch, I'd say make the switch. You're obviously unhappy with what you've got or you wouldn't be looking at other options and asking the internet.
FWIW, I'm in my mid 30s and changed careers ten years ago. I was a chef and loved what I did, but I had a boss that completely killed my passion to grow or even sustain. I literally got a raise when I quit for a job scrubbing toilets. I found my footing in power plants and now I'm an operator in-house. It's never too late to make a change. You're never in too deep. And in many cases, it's gonna take a step down before you have a chance to rise up higher. Never stop learning and growing. Cheers and good luck :)