this post was submitted on 28 Nov 2023
2 points (100.0% liked)

Data Hoarder

170 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Any recommendations for cleaning and organizing an image folder? I have a large amount of images over the past 10 years that are really messy and have been backed up and restored multiple times. I think I have a lot of duplicates in this folder but it’s thousands and thousands of files.. is there any easy way to remove the duplicates? And how do you guys organize your Image folders? Thanks for any input!

top 6 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 11 months ago (1 children)
[–] [email protected] 1 points 11 months ago

Ive used Clonespy but I'm so scared of false positives that I started using Renamer (den4b) and using a hash/date file name for sorting. It doesn't really help with resized, corrupted, modified (exif), or anything like that. Will watch this just to see if anything else gets brought up.

[–] [email protected] 1 points 11 months ago (1 children)
[–] [email protected] 1 points 11 months ago

How did you set this up? Shared folder, Linux filesystem, container, something else?

[–] [email protected] 1 points 11 months ago

Ive used Clonespy but I'm so scared of false positives that I started using Renamer (den4b) and using a hash/date file name for sorting. It doesn't really help with resized, corrupted, modified (exif), or anything like that. Will watch this just to see if anything else gets brought up.

[–] [email protected] 1 points 11 months ago

Duplicate cleaner by digital volcano there is also visual similarly Duplicate image finder by mind gens which is useful for images that look exactly the same but are different file formats.