this post was submitted on 18 Nov 2023
1 points (100.0% liked)

Data Hoarder

170 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

what's the archive type with the bext size compression (lowest size after archiving) but that has partial extraction (extracting specific files) ?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago

It's dependent on dataset. I would suggest 7z and simply uncheck "solid archive". There is info here on running a test to find the best compression: Link

You may want to look into filesystem compression. As it will be much easier to implement and may suit your needs.