It's A Digital Disease!

The original post: /r/datahoarder by /u/artemis73 on 2025-03-28 01:18:47.

Hello,

Do any of you fine folks know of an app that I can use to merge similar folders I've got littered all over my NAS?

At one point I had 3 external drives that have similar files and folders backed up over the years with maybe some sublte differences. I imported all the data from these drives with the hope that I can curb the mess on the NAS and then use these drives as an external backup medium again.

Do you all know of an app that I can use to help me comb through about 8 TB of data and maybe merge similar files and folders? Any help would be appreciated.

Thanks!

The original post: /r/datahoarder by /u/skynetarray on 2025-03-28 01:16:54.

I want to collect some knowledge from YouTube with Pinchflat.

I’m searching for YouTube channels that provide knowledge and information, whose target is to educate, especially those who go into deep detail and wrap it up nicely.

Kurzgesagt or Veritasium are probably good examples for what I mean, also melodysheep.

Do you have some more suggestions?

The original post: /r/datahoarder by /u/RepentHarlequin73 on 2025-03-27 23:53:38.

What ocr app can reliably process pages featuring a mix of roman letters, japanese kana and kanji, korean hangeul and hanja, and chinese hanzi? I'd prefer Macos apps or scripts. Thanks !

The original post: /r/datahoarder by /u/J00433996 on 2025-03-27 22:12:16.

What’s the difference between verbatim m discs and such. I read a lot about verbatim being bad but nothing on the mdisc website linked on Wikipedia. Is it better or the same or what? I just want a disc I can store a bit of data on that’ll last a long time in reasonable conditions hands off. Ideally like 100-200 some years. Cold storage.

The original post: /r/datahoarder by /u/drupadoo on 2025-03-27 21:26:35.

Run a VPN server and VPN in? Open the ports and mount directly? Just use a webui like owncloud instead of mounting?

Also want to prevent it from constantly trying to reconnect when I am remote, but connect automatically when home

The original post: /r/datahoarder by /u/quietgui on 2025-03-27 20:30:01.

To save space I only selected the DTS-HD MA tracks and not the DTS core tracks when ripping my blurays. Now I noticed that probably my firetv stick 4k is incompatible with the HD MA format and it causes severe audio sync issues. Now I want to encode the audio tracks to EAC3 or AC3 and wanted to ask which is better to experience the full surround effect? I‘m planning to do that with ffmpeg, encode just the audio and then use mkvtoolnix to migrate it into the original mkv file. If there’s a better/easier option please point it out. P.S I can’t simply re-rip the discs because some where from the library, friends etc.

The original post: /r/datahoarder by /u/reptileoverlord on 2025-03-27 19:26:32.

Hi folks,

I have ~20 TB of data spread across multiple hard drives. The general vibe from here seems to be that it's time to get a NAS, but there's one problem... I currently am stuck with a shared xfinitywifi network. I want to be the only person to look at my horde of obscure CD rips, I don't want anyone else to access files directly nor via some kind of man-in-the-middle. My internet is also 100% wireless (no ethernet) and about 25 Mbps down/1 Mbps ip.

What I currently have: * Moderate experience with Docker, Linux, and Windows * A raspberry Pi which can be turned into a server/offline storage system/doorstop * Three preowned 3.5" internal HDDs, one 8 TB and two 1 TB * Two external HDDs, both 8 TB (one is ancient and will likely fail soon) * A half dozen small (~100 GB) 2.5" preowned internal HDDs I got for basically free

My PC case is too small to fit more than 2 3.5" drives and even then they are staked directly on top of each other.

What I can reasonably afford in new equipment right now: ~$250, but I can save up more if there's a pricer long-term solution.

I am already using cloud storage for some things, but I've hit the limit of what I can store before I start paying out the nose.

What would you recommend for someone in this weird situation?

The original post: /r/datahoarder by /u/ChildhoodOk7960 on 2025-03-27 18:38:24.

I have used and worked with computers my entire life, and I have accrued a considerable amount of data during the years. I mean everything from old pictures and videos, media of all sorts, personal music projects, work projects (mostly programming, but sometimes including large datasets), personal banking and administrative information and so on and on.

My ADHD has pushed me to try different lines of work, and sometimes I've abandoned projects for a long time before resuming them months and even years after. Additionally, I regularly use two different workstations in addition to a laptop and, sometimes, an additional desktop at work.

I have over the years been trying to come up with a system to keep track of everything in a way that makes sense and keeps my folder structures from disintegrating into chaos or inescrutable deep hierarchies that makes finding things impossible, with varying degrees of success.

I recently built a 6x16Tb RAID6 array on a Linux workstation after a partially recoverable disaster, and I've been backing up all of my old data there, in addition to a large number of newly scanned old family pictures I would like to preserve for posterity.

I am curious about what strategies have other people come up with to separate personal from professional data and projects, how to keep data from desyncing between computers, how to store and index large music and video libraries, etc. I also realize different data have different storage and security needs, and I have yet to figure a system that satisfies most of my necessites.

Any advice or strategies are warmly welcome.

The original post: /r/datahoarder by /u/Pe45nira3 on 2025-03-27 18:22:14.

I want to set up a NAS, but even the cheapest Synology 2-bay DiskStation is pretty expensive, and I can get a used PC with these specs for the quarter of the price of a DS223j (which isn't even that good among Synology devices as I've read).

The original post: /r/datahoarder by /u/clickyk2019 on 2025-03-27 18:03:54.

Until recently I was able to backup almost everything on a single external 20TB drive; it's no longer the case. What would be the best solution for an ever increasing storage size.

• Buy a 22TB or 24TB external drive

  • (+) easy
  • (-) short term solution
  • (-) need to buy another drive
  • (-) not growable

• Concatenate 2 or 3 drives in a linear RAID (ex: 14TB + 12TB + 8TB = 34TB)

  • (+) no need to buy other drives (already have them)
  • (+) linear RAID is supported with mdadm on Linux
  • (-) no redundancy; like RAID 0, if one drive fails, everything is lost
  • (-) not growable
  • (-) need a PC or NAS enclosure for the backup

• Create a RAID5 with 3 or 4 drives

  • (+) redundancy
  • (+) growable
  • (-) need to buy at least 2 other drives
  • (-) need a PC or NAS enclosure for the backup

• Deleting files :)

• Other options?

The original post: /r/datahoarder by /u/Naia_07 on 2025-03-27 16:44:17.

I was gifted an external hard drive

Toshiba Canvio Basics 2TB Portable External Hard Drive USB 3.0, Black - HDTB520XK3AA

https://a.co/d/1414AYG

I put my data on it for gaming and music everything was going fine until one day my iMac decided to automatically update itself and then the hard drive stopped mounting to my computer. It is formatted in MAC OS Journal ( I didnt learn until later that there were better formats for it). Naturally I ejected it from the computer and then when I tried mounting it to another mac computer with older softer it still did not work and I noticed that it wiped itself of my data which sucks. I didnt realize how much I didnt know about hard drives until I really did a youtube deep dive and on top of that realized that Toshiba sucks. I am a sims player and music producer so I wanted to store my gaming files and my VST files on a separate device since the iMac I working on only has 256gb until I could afford something larger. When I went into disk utility it just said 2TB instead of the 100GB of files that were on there and it was greyed out completely and ever since then I have left it alone.

I already read online that when having issues with an external hard drive that you shouldn't try to force anything and leave alone until a professional can get to it. So I am looking for reccomendations on anyone that knows any reputable websites that maybe can recover the data or any better har drive brands I can use as I also found out that the type of format, brand, and type of external hard drive it is. I didnt think it back up my data either cause it didnt dawn on me to do so. If all else fails I just have to re download the VST and sims files on something else is just tedious to do so (sighs)

The original post: /r/datahoarder by /u/CaptainFearless8579 on 2025-03-27 16:43:39.

Thanks in advanced

The original post: /r/datahoarder by /u/Leather_Necessary184 on 2025-03-27 16:28:02.

I just recently made my first refurb HDD purchase of an MDD 22TB HDD from GoHardDrive ebay store to put in my 6-bay TerraMaster DAS and was curious what you guys normally do first, second, etc after getting one of these drives regarding stress testing/identifying/conditioning/formatting/whatever-ing.

The original post: /r/datahoarder by /u/R3PAIRS on 2025-03-27 15:56:07.

Hi all,

I'm after HP Lto-4 1760 W62D firmware. Does anyone have this file that they could please send / share if you have it.

Bonus if you have other firmware files to send for all / any varients. I did get a google drive from here previously. but it doesnt have it unfortunately.

PLEASE HELP

The original post: /r/datahoarder by /u/IWriteTheBuggyCode on 2025-03-27 15:51:35.

I have an enclosure that can hold 4 drives. Currently it was 2 14 TB drives with a ZFS striped set up. I want to add 2 more 14 TB drives, and end up with 3 striped, one parity. Is there a way to do this without copying all the data off and back on again?

The original post: /r/datahoarder by /u/Aggressive-Energy465 on 2025-03-27 15:35:05.

The original post: /r/datahoarder by /u/doorsofperception81 on 2025-03-27 15:23:27.

Hi,

I've researched a lot here and elsewhere but still failing to get a clear answer. Hoping some of you fine people can advise.

I'm a photographer/director and need a new larger archiving solution.

Currently I have a 10TB G-Drive Raid (2 Bay) Thunderbolt 3 set up as Raid 1. So 5TB storage in total.

I also have a 5TB external that I keep offsite and sync once a month. (This is secure enough for me as I also have the last months of work on my external 'shoot HDs').

I have no need for it to be online either now or in the future so a NAS system isn't necessary. I also have no interest in costly cloud storage subscriptions.

So, I'm considering these options:

Option 1

• Replace the Raid drives with 2x26TB (WD Ultrastars 7200)

• making use of the existing enclosure and thunderbolt 3 speed

• I'd also have 3rd separate 26TB for off site backup

Option 2

• Buy a new 4 bay enclosure with 4x10TB (WD Ultrastars 7200). So 27TB storage in SHR or RAID 5.

• would probably be USB3 as Thunderbolt3 is a little expensive, so transfers would be slower.

• I'd also have a separate 26TB for my off site backups.

I'm inclined to go with option 1 as it's what's worked for me so far.

Would there be any advantage to option 2?

Thanks

The original post: /r/datahoarder by /u/_stracci on 2025-03-27 13:59:53.

I have an Exos X24 Model No: ST24000NM007H with SAS interface, what connector can I use to connect it to a SATA motherboard?

Is there a SAS to SATA cable?

Thank you.

The original post: /r/datahoarder by /u/marmosettacos on 2025-03-27 13:11:08.

I have 500+ gb of over 40,000 video game music files (flac/mp3/ogg) saved to a hard drive. I want to save it all to a microSD so I can listen to all of it seamlessly on the go. I'm wondering if anyone can recommend any music players that support multiple file types at the same time and bigger (probably 1+ tb) microSD capacity.

The original post: /r/datahoarder by /u/Aight__T on 2025-03-27 11:08:44.

I use "Aka" which is a less known version of Nicegram to save vids from private canals and it works perfectly well. The thing is, because I didn’t watch completely some saved videos, these didn’t load until the very end but in the meantime the canals got deleted. I find myself having the vids in my saved messages of the app but without having them played completely and when I try to download them it’s stuck to where I left the video the last time I watched it for example (4.9MB/ 23.7MB) Is there a way to fix the problem ? Are the vids definitely lost ?

The original post: /r/datahoarder by /u/rslegacy86 on 2025-03-27 09:45:48.

Hi all,

Originally posted on r/techsupport, not getting much, I'd be interested in the thoughts of this community.

Thinking about the bathtub curve for hard drive failures, how do you go about burning in / stress testing your new drives, particularly those that are used for cold storage? Do you do it at all? What's your approach / reasoning?

The original post: /r/datahoarder by /u/Mango__323521 on 2025-03-27 09:35:00.

so i’ve been using this site for the last month or so. no clue where they came from, but they offer infinite free cloud storage.

whats the catch? they get to “anonymously” use your data….

I’ve always strictly avoided cloud storage till I came across this. I still dislike it tbh and all my “real” backups are sharded with duplication across a series of physical drives. that said, i do various side projects where i wind up with large datasets and dont really care to store them. i’ve been uploading them to everstore and they… havent caught on so far? I have about 0.75tb of image data in there. its not any personal photos so i dont care if they use the data for anything.

thoughts?? anyone else tried this? tbh I have no clue where everstore came from, seems like a GPT’d project without much thought into rate limiting or anything.

The original post: /r/datahoarder by /u/clarkky55 on 2025-03-27 06:09:10.

I downloaded and tried to use this https://github.com/prof79/fansly-downloader-ng?tab=readme-ov-file

I thought I'd set everything up but I keeps throwing this error, [43]ERROR | 16:03 || Unexpected error during Timeline download:

Traceback (most recent call last):

File "download\common.py", line 151, in process_download_accessible_media

File "download\media.py", line 202, in download_media

File "fileio\dedupe.py", line 74, in dedupe_media_file

File "fileio\fnmanip.py", line 71, in get_hash_for_image

File "imagehash\__init__.py", line 272, in phash

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\fftpack\__init__.py", line 93, in

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\fftpack\_basic.py", line 8, in

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\fft\__init__.py", line 91, in

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\fft\_fftlog.py", line 10, in

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\fft\_fftlog_backend.py", line 4, in

File "PyInstaller\loader\pyimod02_importers.py", line 419, in exec_module

File "scipy\special\__init__.py", line 807, in

File "scipy\special\_ufuncs.pyx", line 17294, in init scipy.special._ufuncs

ModuleNotFoundError: No module named 'scipy.special._special_ufuncs'

can anyone in the know either tell me how to fix this or suggest a different program?

The original post: /r/datahoarder by /u/awolfwearingabanana on 2025-03-27 03:14:40.

The title says it all, I was originally trying to use wget to download this specific collection https://catalog.archives.gov/search-within/530707, but it just wont download. I want to archive this because I don't only find it cool and I want to keep a copy of it on my drive, but I also want to do my part to combat the purges. I would also know how to filter the download to only download the images and documents, and none of the site assets? Such as only downloading the .tiff, .jpg/jpeg, png, and pdf files in the catalog.

Wget command I was running: wget --mirror --page-requisites --convert-link --no-clobbe robots=off --no-parent --user-agent=Mozilla --random-wait --recursive --domains archives.gov https://catalog.archives.gov/search-within/530707

The original post: /r/datahoarder by /u/Master-Roashi on 2025-03-26 23:05:33.

I grew up during the VHS,CD and DVD era. Taping the main tv shows was something that I loved doing. It was never for a monetary gain. But I always feel, that it’s a cherished moment. And what if, this is the last time we see it. And I’ll record the show tape after tape. When I got my first pc, all I could think was to run a capture card to capture the tv shows. And I always just keep them. The only time I ever take them out was if someone was looking for a particular show. Today, I’m still hoarding data. Is this a sickness? Like a real life hoarder? I swear, if ever the data servers become corrupt, and the major companies loose their soft copies, they’ll all come running to us data hoarders to complete them again. I believe that we should be able to own our purchases. Same for the shows that we pay for. It’s sad that the online stores can just remove shows and apps that we pay for. It doesn’t even stay as an offline resource. Still, sickness or not, I feel we are the unsung heroes of the digital age. Keep it up guys.