Not just switching the default; have a go at removing Edge entirely, its a huge PITA.
You've gotta manually take ownership of Edges files, including its updater service, force that service to close and delete it, then finally delete the files for Edge itself. If you do that out of order, or you install certain system updates; it'll reinstall itself so you have to do it again.
From there some simple things like the news+weather taskbar widget and the start menu search will no longer open/function. (they ignore your default browser setting and forcibly use Edge)