I only have experience with docker not podman so this may be completely useless, but I found that some containers respect environment variables

environment:
  - PUID=xxx
  - PGID=yyy

and some use the user mapping

user: xxx:yyy

(I guess this needs translating to uidmaps for podman). Maybe this is an issue here? Although #3 makes it sound like maybe not...