You probably have heard this before, are you using the native version? It’s somewhat better there, but still an issue.
Voyager is built with a different framework (ionic/capacitor) than e.g. memmy (react native afaik) or Mlem (SwiftUI). The part that’s causing this isn’t done by the devs so it’s more or less out of their control. I’m pretty sure it can be fixed, I just don’t think it’s a high priority for whoever could fix it and if it’s an issue in iOS (is it a problem on Android as well?) or the framework.
So the fix for aeharding would be to use a different framework, which I’m pretty sure is not going to happen. But there are many other apps out there, feel free to pick one that doesn’t have this issue.