this post was submitted on 19 Nov 2023
5 points (100.0% liked)

Self-Hosted Main

502 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS
[email protected]
5
What is the best duplicate file finder, that preserves my source of truth? (alien.top)
submitted 10 months ago by [email protected] to c/[email protected]
26 comments fedilink hide all child comments
 

Having been so meticulous about taking back ups, I’ve perhaps not as been as careful about where I stored them, so I now have a loads of duplicate files in various places. I;ve tried various tools fdupes, czawka etc. , but none seems to do what I want.. I need a tool that I can tell which folder (and subfolders) is the source of truth, and to look for anything else, anywhere else that’s a duplicate, and give me an option to move or delete. Seems simple enough, but I have found nothing that allows me to do that.. Does anyone know of anything ?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 10 months ago (3 children)

How should a duplicate finder know which is the source of the duplicate?

[–] [email protected] 1 points 10 months ago (1 children)

I’d like to find something that has that capability- so I can say multimedia/photos/ is the source of truth - anything identical found elsewhere is a duplicate. I hoped this would be an easy thing to as the ask is simply to ignore any duplicates in a particular folder hierarchy..

[–] [email protected] 1 points 10 months ago

Well that's possible with a lot of deduplicators. But I'd take a look at duff:

https://manpages.ubuntu.com/manpages/xenial/man1/duff.1.html

https://github.com/elmindreda/duff

The duff utility reports clusters of duplicates in the specified files and/or directories. In the default mode, duff prints a customizable header, followed by the names of all the files in the cluster. In excess mode, duff does not print a header, but instead for each cluster prints the names of all but the first of the files it includes.

 If no files are specified as arguments, duff reads file names from stdin.
load more comments (1 replies)