32

So, I've been running offsite copies to OVH S3 bucket via PBS running as an VM but I ran into an issue that verification of the backups is so slow that they're practically unusable.

Copies run nightly and I've set the storage to keep last 4 copies in place. Bigger VMs, like my immich-instance with a bit over terabyte of data, take several days to verify and logs show data rates at around 5MB/s or less. So, with the current schedule I'm running it'll mean in practise that backups expire before they're verified.

I could keep the copies longer, but that'd cost more, or run copies less frequently, which risks losing data if hardware fails at unfortunate moment (which it most likely will). Tuning settings are on default and based on what I've read, adding more runners wouldn't really help that much.

PBS VM itself shows very little load on proxmox monitoring and I've got plenty of bandwidth to use, so the verification shouldn't have any bottlenecks on my end at those speeds. Cache usage is at around 60% with ~30GB of total space available.

Does anyone have any ideas on how to speed that up? Or should I just give up and do something totally different? I attempted to run backups to Hetzner storagebox over cifs-mount, but that's pretty much the same or worse with performance.

you are viewing a single comment's thread
view the rest of the comments
[-] 9tr6gyp3@lemmy.world 1 points 2 weeks ago

Healthy storage pool? Any disk errors?

[-] IsoKiero@sopuli.xyz 2 points 2 weeks ago

No errors and I have separate local backup server with spinning drives too which works just fine. Local backup server has ~5,7TB of data and verifications complete in about 5,5 hours. Actual (incremental) backups to S3 take about two hours with that ~2TB on VMs which seems decent enough.

this post was submitted on 21 May 2026
32 points (97.1% liked)

Selfhosted

59731 readers
1120 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

  7. No low-effort posts. This is subjective and will largely be determined by the community member reports.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS