I unregistered it manually which fixed it for one refresh (which then installed the service worker), but then after the next refresh it just went back to the same as before.