this post was submitted on 13 Nov 2023
1 points (100.0% liked)

Data Hoarder

170 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago
MODERATORS
 

Hello ๐Ÿ‘‹

I'm feeling overwhelmed by the amount of work I created for my-self, my files are a mess.

  • How much time you spend just sorting and cleaning all you images?
  • Do you have the same folder structure for all you storage locations? (hard drives, cloud,...)
  • How many files do you have?
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 1 points 1 year ago (1 children)

You're not asking too much, but you will need a server (or some way to run the software) to actually create some sort of organization, image/object/face recognition processing, etc. that is indexed and can be searched. Depending on what tasks are being run will depend on how much system resources you'll need or what specific hardware is required to process the files.

Now, does the technology exist there to do what you are looking for without needing to get a server yourself? Yes, it absolutely does. However a lot of it can be found within Media Asset Management systems (not free) that connect to services that do the actual processing (costs extra and really not free). Like, if you wanted to search through your images and find every image with a red coffee cup in it, you could.

This also goes without saying, but if you have a single HDD with all your photos on it, the last thing you should be doing is running high I/O tasks on that HDD if that is your only copy. You should ingest those files into whatever solution you want and process it there, leaving the original intact. Ideally, duplicate that HDD and work off the duplicated data.

[โ€“] [email protected] 1 points 1 year ago

Here is the thing: I don't trust cloud services to still exist in 40 years

Even open source ones, they are very complex and if the people maintaining it stop working on it, I'm doomed.

Is why I don't want a server to run.

I have seen people using Adobe Lightroom to do sort of what I'm looking for. But too expensive.

As a DataHorder, by using those servers you are talking about, are you sure you will still have access to them in the future?