this post was submitted on 18 Nov 2023
1 points (100.0% liked)
Data Hoarder
168 readers
1 users here now
We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That is kind of inconsequential as you can always compress the files individually if you wish and then make a tar with all of them together.
The question is what files you have, based on that various algorithms would do better or worse. And of course not doing solid archives would add a penalty to most algorithms if the files are somehow similar.
images and videos
mostly jpg png mp4 webm
Tar.
Mostly not joking here -- the image and video formats you list are already heavily compressed. You'll be lucky to get even 1% compression from any format, so you might as well just package them up in an uncompressed archive format.
These formats are generally not very compressible by general purpose compression algorithms, as they are already compressed formats themselves, each with a compression algorithm specially tailored to their content type.