But then what’s stopping someone in France from sideloading the app and using a VPN?
The need for a phone number and SMS verification to create an account. Signal should do something about that.
There are ways around that, but the goal isn't to stop everyone from using E2EE; it's to make E2EE non-mainstream.