I've replaced some "non replaceable" batteries in phones before... Only to find that after about 5 years of medium use the flash storage goes to shit (which causes massive slow downs), the chips begin to desolder themselves, the USB port gets janky and stops charging, etc.
Batteries are a great first step, but damn these $1000+ devices just are not built to last more than 3 years