It's A Digital Disease!

20 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
126
 
 
The original post: /r/datahoarder by /u/TheRealHarrypm on 2025-04-04 06:00:40.

The long-awaited classic demonstration tape for using VideoPlus, decided to throw up the captures as a reference demo, this is transferred for Andy (Robust Reviews) for his video on the actual hardware remote which is a great watch for a little bit of home recording history.

This is a re-upload & re-post as there was a scripting error with the deinterlacing (BFF instead of TFF processing)

127
 
 
The original post: /r/datahoarder by /u/Legitimate_Pea_143 on 2025-04-04 05:49:11.

I've tried using anydriib countless times now and it's never actually worked. I download the file (usually a zip or rar file) and it's always says the file is corrupt. i have NEVER had any luck using anydebrid or any other debrid site.

128
 
 
The original post: /r/datahoarder by /u/HopeThisIsUnique on 2025-04-04 05:43:13.

So many years ago I picked up a Nimbie CD robot with the intent of doing my library. After some software frustrations I let it sit.

What options are there to make use of the hardware with better software? Bonus points for something that can run in Docker off my Unraid server.

If like to be able to set and forget doing proper rips of a large CD collection.

129
 
 
The original post: /r/datahoarder by /u/TeacupTenor on 2025-04-04 01:42:34.

I've been using GoodSync to backup data for a number of years. I use a two-way sync so that the two drives I copy back and forth contain the same data.

I've noticed that periodically GoodSync's backup space estimate goes way up in my target drive. When I check what it wants it to sync, I see a list of basically the majority of my files. I've noticed this happen with portable hard drives, and today, for the first time in a portable Samsung Shield rugged SSD.

I used to believe that it was some kind of break down in the hard drives themselves, but now I'm not sure, since the SSDs have never given me trouble before.

Has anyone else experienced this? Is there a setting that maybe I'm not using correctly that is somehow making GoodSync "refresh" the data?

Thanks.

130
 
 
The original post: /r/datahoarder by /u/UnassumingDrifter on 2025-04-04 01:10:36.

I'd like to back up my main file server to another machine I built. I have about 40TB of data: 80% is large-ish media files, 20% is documents, photos and smaller files. I'd like a solution that can take that into account when setting up the backup. Currently I'm using, and successfully, Duplicati. It's free and open source and I like there is a Web UI even if it's kinda plain. What I don't like is that it isn't super fast. It will spike to 3.5Gb/s network thruput for a few seconds, then jump down to 1Gb/s or less for a minute or so. I am using a Threadripper 5955WX for the backup machine with a bcache backed RAID6 array. Based on fio test I should be able to sustain 3.5GB/s random writes and my file server can sustain that based on tests. What I think is happening is it appears that only 1-thread is being used for compression / etc. SO, I want something faster.

What I want: Speed - should be able to utilize hardware better. I'd like to be able to backup to local drive, not interested in cloud backup. I'd like it to work with smb shares. Docker would be nice but I'll settle for a local installed app as long as it works with openSUSE Tumbleweed. I don't mind buying something if it's reasonable price, but I do expect if it's a pay program it has a better UI than the free stuff. I do see Duplicacy has a free CLI but I'm more interested in something with a GUI, and preferably a Web UI so I can manage it remotely, so that's the Home Version. I'm not opposed, but I really don't know yet if it'll be more performant than Duplicati. Anyway, this got me thinking - if I'm willing to pay, what is out there? I know about Veeam but I tried a demo and ran into difficulties. It's been a bit so I don't recall what the issue was but I moved on.

What other "pay" backup applications should I consider? If there's a free one you can think of besides Duplicati I'm down. I did try some Borg backup docker UI container but I had issues. Again, maybe I'm the issue, but just getting that out.

131
 
 
The original post: /r/datahoarder by /u/CantStandIdoits on 2025-04-04 01:07:51.
132
 
 
The original post: /r/datahoarder by /u/TristinMaysisHot on 2025-04-04 00:32:42.

I'm trying to get a list of all files on a hard drive. For example on E: I have 5 folders and inside those folders are thousands of movies. There is also some sub folders inside the folders. What is the best way to go about getting a list of everything?

I tried doing this command i found on Google, but it doesn't do anything.

dir e:*.* /s /on > c:\filelist.txt

133
 
 
The original post: /r/datahoarder by /u/fletchnuts on 2025-04-03 23:10:26.

I recently purchased and shucked two of the Seagate Expansion 28TB external drives (labeled as Barracudas), and put them in a Terramaster D4-320. The Terramaster site says the enclosure only supports up to 22TB, but these 28TB drives are working just fine.

This is just an informational post because I couldn't find any information the D4-320's support for larger drives.

The read/write performance of these drives is pretty good. I'm seeing about 240-260MB/sec.

134
 
 
The original post: /r/datahoarder by /u/johnny_ringo on 2025-04-03 22:45:07.

Original Title: Question for the serious DHer's with 70TB of data+ How do you organize everything in your personal collection. And I mean everything- from email, to photos, to videos, to receipts, to unique app project files...


Photos, Videos, Large 3d data files, personal projects, mail backups... basically my life and creative work all in one spot. Sorting videos and photos by year makes sense, though it is tedious to rename every date + a quick descriptor. Then it gets REAL tedious to go through those odd folders that are 1TB of small files called "x-to sort later" Do you organize by filetype? by year? by big events? Last question, how do you know what files are just a waste to keep- like those thousands of .col files that Capture One weirdly creates? Thanks.

135
 
 
The original post: /r/datahoarder by /u/burnthew1tchh on 2025-04-03 20:41:28.

Hey guys, so I've backed up my linux server via rsync and I was thinking of creating a cron job to backup new files, and backup files that were changed but I don't want the deleted files in the main server to be deleted in the backup. So it's not 1:1, I guess?

If I have files A, B, and C in my server and it's backed up. And files A gets deleted, B gets changed, and C remaings the same. When I do a backup. I want to retain A, B changes and C is not touched. I would like to continue using rsync if possible.

Sorry, english is not my first language. Adding 'Backup' flair but I know this is not a Backup setup. It's a hoard all the files setup. hehe

136
 
 
The original post: /r/datahoarder by /u/SupermarketNew5003 on 2025-04-03 07:22:15.

I’m building a private home server to archive my media library for personal access.

I’ve run into handshake issues when using streaming devices through capture hardware — some signals don’t pass through properly.

Can anyone recommend a 4K HDMI splitter (HDMI 2.0 / HDCP 2.2) that works well with streaming boxes and capture cards, and maintains full signal without blank screens or errors?

Not redistributing or uploading anything — just trying to maintain a personal offline library.

137
 
 
The original post: /r/datahoarder by /u/Slammernanners on 2025-04-03 03:00:01.

I need to search the big 2009 GC archive dump semantically for sites about a specific kind of music. I've tried Google site search for geocities.ws, but that feels a little jank. Is there an alternative before I go reinventing the search engine for this HUGE dataset?

138
 
 
The original post: /r/datahoarder by /u/DearPlankton on 2025-04-03 22:06:45.

Someone is selling a bunch of them used for about $9-10/TB and offers 30 day warranty. I've been following them daily and their listing has been up for quite a while.

Should I bite? Should I ask them for anything before purchasing?

edit: Got it, not biting

139
 
 
The original post: /r/datahoarder by /u/duchuy613 on 2025-04-03 21:52:12.

I'm currently using gen3x4 board, but I wanna get a 1TB gen4 SSD for the future gen4 board. The current best options I have (in my opinion) are:

  • Kioxia Exceria Plus G3: $53.5
  • WD Blue NS580: $54
  • Kingston NV3: $58
  • WD Black NS770: $64
  • Samsung 990 EVO: $67.5
  • WD Black SN850X: $77

I'm on a budget, so I'm looking closer at the Kioxia and the NS580. Are the more expensive options just marginally better? Or are they better by a large margin that justify the price difference? Alternative recommendations are welcomed too.

Edit: I mostly use the PC for gaming, but I do some modding so files are being moved around, most of them small in size.

140
 
 
The original post: /r/datahoarder by /u/Gullible_Eagle4280 on 2025-04-03 21:49:14.

I've been wanting to upgrade to an N5 case for a while but shipping charges have been prohibitive. The shipping was as much or more than the case itself! (I should also add I am in Mexico) But today I was looking around Ali and just searched N5 NAS case and there are a ton of sellers selling them under various other brand names, many of which have FREE SHIPPING! It says "Shipped from the United States" in the listing I purchased mine from. It's listed as a "Top N5 NAS Case. So if you're in the U.S. (or Mexico) and shipping costs have been too much, hopefully this will help you.

https://preview.redd.it/ojga353pvose1.png?width=1690&format=png&auto=webp&s=72544c7bd699a69f21d06df774095376379bd575

141
 
 
The original post: /r/datahoarder by /u/chubbyassasin123 on 2025-04-03 21:21:19.
142
 
 
The original post: /r/datahoarder by /u/Infinate_ on 2025-04-03 21:17:02.

Hey everyone Hope this is okay to ask! I’m currently looking for a new 2TB External hard-drive. My current one broke. Thankfully it works still but barely hanging on by a thread and I need a new one to store my thesis work and other things.

I’m not knowledgeable on this all I know is I would like at least 2 TB storage for the harddrive and was told to look at one with USB-C connection Other than that I’m unsure about what else I should look for I currently have a 2TB sea gate and that’s all I know.

Anyone have any recommendations?

143
 
 
The original post: /r/datahoarder by /u/joshd523 on 2025-04-03 21:06:48.

I’m working on an art piece and need a text file with the entire speech, doesn’t matter if there are minor spelling mistakes throughout. I used Jdownloader for the live stream, how do I get the text though?

144
 
 
The original post: /r/datahoarder by /u/Jadarken on 2025-04-03 20:41:59.
145
 
 
The original post: /r/datahoarder by /u/Yashooo on 2025-04-03 20:40:39.

I can only find this one --> https://archive.org/details/youtube-U34MFcJdGCo

and a couple others

146
 
 
The original post: /r/datahoarder by /u/FlufferNutter1232 on 2025-04-03 20:37:50.
147
 
 
The original post: /r/datahoarder by /u/GenericUser104 on 2025-04-03 20:36:53.
148
 
 
The original post: /r/datahoarder by /u/Ben2ek on 2025-04-03 18:59:49.

Does Web Archive have repos for their Collections? Trying to to get the underlying data and documents from these two links in particular, but interested in a lot of the Collections datasets.

149
 
 
The original post: /r/datahoarder by /u/AnnieLeo on 2025-04-03 18:31:36.
150
 
 
The original post: /r/datahoarder by /u/Optimal_Dog_7643 on 2025-04-03 16:51:11.

So it's almost time to get a new NAS. I have a DS 223, with 2x4TB. It's been 8 years, and one drive is in critical condition. I've been casually reading up on the world of NAS again and see that there are so many other brands. The ones that I currently know of are Synology, QNAP, Asustor, and UGreen. I come from a tech background, so not a tech dummy, but not a sys admin guru either.

What NAS brand (ones mentioned above or any other) do you recommend if the following are my criteria in order of priority:

-reliability: this is a must-have, will be using disk mirroring with two drives

-remote login: can access and configure system

-nice UI: meaning, I don't want to configure stuff by typing in commands

-basic features: auto backup, file sharing, user creation

-other features: download station, notifications of issues/status

-extra storage: can plug in extra drives to increase storage space

-easy to use and configure: minimal learning curve to setup stuff because the UI is intuitive

-DLNA: not sure if that's what it's called, but basically, able to access movies and music from the drive with other devices

-VM: able to run Windows via a tablet

-Power efficient: since this will be on 24/7

-Price: this is not that important as the hardware will be used for at least 8 years

view more: ‹ prev next ›