Finamp certainly needs some work but it’s far better than the native Jellyfin application, at least for iOS/iPadOS, I can now listen to music in the background.
Hell the Finamp contributors took my suggestion on a way to sort playlists and actually implemented it so I gotta say much props to them.