It's A Digital Disease!

22 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 1 year ago
MODERATORS
126
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/skreak on 2024-01-21 21:07:01+00:00.


I have quite a few older HDD ranging in sizes from 500GB to 3TB. I'm thinking about using as cold storage backups for my main NAS. Looking for what people doing for the same and what their strategies are.

My NAS is a 36TB (23tb used) raidz2 pool with automated snapshots and unencrypted volumes for each category of data. (Linux ISO's, homedirs, music, roms, personal photos, etc). I automated backup of the important/irreplacable stuff to a 3tb disk elsewhere on a rpi4. (warm backup). I do have a 2 bay USB/Sata dock for quickly popping disks in and out, and another single disk sata/usb adapter.

My initial idea is use pairs of matching sized disks. First run badblocks and validate each disks is healthy. On each of them make a small vfat volume with a README and other details about what the disks contains and how to access it should someone in the distant future who isn't me try to read the disks on a windows box. On the remaining space make a mirrored ZFS pool with both disks. For volumes that can easily fit entirely on one set of disks (like my /home is only 600GB) use zfs send/recv and add encryption on the receiving end. On sets too large to fit, instead create new encrypted volumes and rsync the data over, splitting the volumes up alphabetically and fitting as much as I can. The README will contain information on where to find the decryption keys. Afterwards catalog and name each disk with post-it notes (coldbackup-1a and 1b). Keep a running copy of what is on each pair of disks and when it was last scrubbed in a central document. Then store the drives in static bags with silica packets in my basement (cool, steady temperature, and relatively dry). And make calendar events so every 2 to 3 years I go through and scrub all the disks and replace as needed. On super irreplacable stuff (family photos and the like) maybe I even use a 3-way mirror using another sata-usb cable i have.

Thoughts? What would you do differently? Is encrypting backups a bad idea even if I make sure that Key's are recoverable (i may even print out QR codes on paper in addition to KeePass). Is there a benefit to settings copies=2 in a 2way mirror for this use case?

127
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/zp-87 on 2024-01-21 20:32:20+00:00.


I want to move my backups to different location, since in the case of fire or theft I could lose all data.

I was thinking to copy everything on external 2.5" HDDs and store them far away from my apartment.

I have:

  • Maxtor M3 Portable External Hard Drive (4TB)
  • Seagate Basic Portable Drive (5TB)
  • and plan to buy WD Elements Portable Black 2.5 (5TB)

All drives are new and not used much. I have a house in a countryside and that is where I plan to keep my offsite backup. No one lives there and temperature can go from -20°C to 40°C.

I was wondering do you have any suggestions on how to store these drives? I guess I need to keep them in shade and keep them dry. Do I need to buy some protective materials to isolate them better?

I would like to keep them in a good health for 10 years and to replace them after. Not sure if these ones are able to live that long (even when not used), since they are the cheapest I could find.

128
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/pelosnecios on 2024-01-21 20:30:38+00:00.

129
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/xqoe on 2024-01-21 20:11:10+00:00.


I know that there is individual that share storage between themselves and I know that there is FileCoin

But no fren and FIL is actually just a currency to give to classic providers

I search for a way to share my storage P2P on a network with random people and get the same transfer/storage amount in return, no money

Only problem being availability as I don't have a server, so I can't be online all the time. And my data is metered so I want to share really few data because basically it'll cost me 4 times the data amount I want to save (like backup 1 GB of data means one upload of me, one of the other one, one download per person too, multiply it by wanted backups)

130
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/ectoplasmic-warrior on 2024-01-21 20:03:53+00:00.


G’day - title may have been weird if so apologies, and I did a search but couldn’t find what I was after

I have a few hundred hard drives - both in servers and also externals

Is there a program ‘anywhere’ that would allow me to scan these drives , and list the contents, and alert me when there are dupes ?

Kinda like a big database ?

Be even more helpful if once the scanning process was done, that ‘this program’ would add new downloads to the database etc

I keep finding that I have multiple copies of various things which is not only a waste of bandwidth but more importantly hard drive space , and the system I’m currently using is obviously really bad

So I figure that there has to be a decent way or organization out there right ??

131
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Diligent_Eye1248 on 2024-01-21 19:44:37+00:00.


I accidentally deleted my documents on my laptop(windows os) and I need them in two days. Any tools for recovery that are easy to use?

132
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/KWalthersArt on 2024-01-21 19:18:44+00:00.


Trying to find a good capture card for digitizing tapes. Haulage pvr2 is my go to for capture but I understand stand it doesn't work with VirtualDub and it has built in compression.

Tried a cheap 5 dollar capture card I bought online and it works with VDub but so far it seems to have Jpg artifacts in the recording, haven't determined if it's the tape or the card but I see compression in VDubs control panel and assume its hardware since I can't turn it off.

I also have a Diamond VC500 that I haven't tried. Pc is running latest Windows.

133
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/raging_pastafarian on 2024-01-21 18:40:25+00:00.


Hard drives, as I understand it, often exhibit warning symptoms before they fail. And SSDs, maybe not so much. But still, I'm certain there must be some software out that to notify you if your drive health is showing anything concerning.

Is there a good light-weight system tray app that can run in the background and run daily checks or something?

I have a Windows desktop machine in my office with 14 GB of storage, and a Windows desktop acting as a server in the living room with 20 GB storage.

134
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/WalterMelon81 on 2024-01-21 18:06:43+00:00.


I understand why WD Blue and Barracuda HDD shouldn't be used for NAS or 24/7 surveillance, I find why it's not recommended to use WD Red or an Ironwolf hd for basic computing? *

specifically a 4tb SG Ironwolfis $79.99 and SG Barracuda $78.99. same rpm and same cache size.

I was just looking for a 4tb non-smr drive, Ironwolf is the cheapest option locally.

*I'm using it to back pictures, movies, and on occasion installing steam games that are too big to go onto my OS's SSD (just a that need150gb+)

135
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Hemlock_Deci on 2024-01-21 17:33:29+00:00.


First of all, sorry if this is kind of a newbie-ish question.

Now, been looking on Google and so far I've only seen a bunch of options:

  • Google cloud backups (up to 15GB free, with 100 or so being paid/subscription based)
  • Cloud backup via jailbreak apps, which are not feasible for me
  • Or a PC, HDD, SSD, or any physical storage media.

My idea for this is to use a PC I have, but I wanted to know if there's a better way, since this is pretty much my first time doing this sort of stuff, and Google mostly led me to somewhat older posts and websites, so things may have changed.

I also wanted to know: if I go by making a backup on PC/external storage, would there be a loss of quality on media files, and if so, is there a way to prevent or minimize it? Some of my files are FLAC audios, 4K images and the like, and I really want to keep them at the best quality possible.

136
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/kalameespeeter on 2024-01-21 10:04:18+00:00.


I'm thinking of buying a portable ssd enclosure but where I live they are pretty expensive so I'm wondering could I buy a 10€ one from aliexpress or are they just complete garbage and I should just pay 12€ more for a better know quality one.

137
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Lycanthrotree on 2024-01-21 03:02:51+00:00.


I'm trying to preserve a very long RPG play-by-post game written on a discord server. It's about 1.5 million words of text. All the other posts I've seen asking about preserving things from discord are concerned with saving photos/attachments or reactions, but I want literally just the text people have written and to specifically exclude things like usernames, dates, and reactions so that it reads like a book. It seems like there should be an easy way to have a program grab just the text and export it to a text file, but I haven't found anything.

Want to keep: The responses people write, formatting if possible (e.g. italics)

Don't want to keep: Usernames, dates, reactions, images, attachments

Any suggestions? I can get admin access to the server as well if that affects what can be done.

138
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/JohnnyDanger79 on 2024-01-21 00:05:43+00:00.


Hello everyone. I upgraded my 12TB (2x6TB) PR2100 with two 10TB WD Red drives. Everything seemed to go well, but I'm running into problem that I cant figure out a solution to. I'm trying to transfer a video file to a folder on the drive and I'm getting an error that says:

"There is not enough space on videos

0 bytes is needed to copy this item. Delete or move files so you have enough space"

There is plenty of space on the drives so this is throwing me for a loop. Does anyone have a recommendation as to how I can fix this.

Thanks in advance for any help.

139
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/AnicManMan on 2024-01-21 17:17:03+00:00.


Anyone know why some highlight covers on Instagram profiles are different, because Instagram has the cut cover and the full cover, but sometimes these two are different.

140
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Uchiha_Landry on 2024-01-21 17:12:02+00:00.


I bought one some days ago. But after buying it I read some people saying that in some moment may expel something like white wax. I read that is something called “Dynamic Thermal Guard”. Now idk what to do or if that will damage the drive. :(

141
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/itsarace1 on 2024-01-21 16:48:32+00:00.


Can't seem to find a recent answer.

I know about the big purge from May 2023 but I'm curious about now. If I upload a picture without an account how long will it stay up? Does it need at least one view every so often?

142
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/anh690136 on 2024-01-21 16:47:05+00:00.

143
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/HisNameWasShagbark on 2024-01-21 16:22:43+00:00.


I am fairly new to this and just recently in the past 6 months or so (June 2023) started to organize my life and data to have better control and archiving. I've got 4 kids, a few businesses, wife, and as everyone can imagine - countless data, docs and files that I should save and stop paying cloud providers for.

I'm now about 8 TB deep into my system. I see how this will get out of control quickly, and my issue that I didn't consider is retrieval.

How does everyone organize or index their data?

I don't mean like file name conventions, tag or folder systems. I am curious if you build a database to store key information such as:

  • Backup Archives
    • File Name | Archiving Date | File Summary | Etc.
  • Directory MOC
    • Directory Name | File Types/Rules | Dates and Source Locations | etc...

I want to avoid the pitfall of when I need to find that one set of PDFs or photos from that one period I think was maybe between August 2016 and March 2017... for example.

Just curious of the process some bigger hoarders have taken to help me avoid a nightmare.

144
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/antdude on 2024-01-21 16:18:20+00:00.


Do you physically destroy them at home and toss the pieces into trash? Go to a place that have drive shredders (can't find many around my location)?

Thank you for reading and hopefully answering soon. :)

145
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/spoticals on 2024-01-21 14:44:05+00:00.


I’m trying to get ahold of some brochures from like 2002, at some point they where digitalized on vwmotorsport.info but have since been taken down. They where saved as pdf files, I have tried using the wayback machine to no avail.

146
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/smaiderman on 2024-01-21 12:21:27+00:00.


Hello. I've been trying to manage my library for years without success. I have photos, backups of these photos, copies with different names, some of them with fucked date metadata...

I wonder if there is a software that finds duplicates, and keep ALL metadata merged, picking the oldest date available for example.

Can you guide me to start organizing this mess? I would be happy renaming all files with it's date

Im talking about 500.000 files aprox.

I'm using Windows 10

Thank you!

147
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/danielrosehill on 2024-01-21 11:32:01+00:00.

148
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/RileyKennels on 2024-01-21 09:38:19+00:00.


I'm using Hard Disk Sentinel for Hard Drive monitoring. It refreshes the disks SMART information every 5 min. However, I noticed that my HDD's heads park (particulary Seagate Exos) every 3 minutes.

Unless I'm mistaken this would mean every 3 minutes my HDD heads park and then are unparked again when the disk's SMART reporting inquiry is made (5 minutes) over and over again causing a quickly increasing head park count.

With modern, especially Enterprise grade hard drives being able to have hundreds of thousands of head park operations in their service life, is this really an isssue?

What is the tradeoff when deciding whether to allow Enterprise HDDs to park at all?

Secondly what are your disk monitoring refresh intervals and what do you use on your system to monitor SMART disk health?

149
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/Sudden-Air-243 on 2024-01-21 07:21:12+00:00.


I am digitizing a bunch of old family photos 1976-1978 onwards some even date to 1970s , and it is also our family tree, so apart from giving relevant file names how can i make a comment or note in the photo as to who are the people in the photo. I am scanning photos in our flatbed scanner as jpg file.

I am thinking of using image editor and add a text line below the photo or wherever there is empty space in photo, but is this a good method of tagging or recording comments about photos?

150
 
 
This is an automated archive.

The original was posted on /r/datahoarder by /u/AlexTheCreation on 2024-01-21 06:06:34+00:00.


There is this lady I follow who posts videos, but every now and then she deletes them. I have managed to download a lot of them, but she's deleting them faster than before.

I'd like to know if anyone knows any automated method to download anything she posts anytime.

view more: ‹ prev next ›