It's A Digital Disease!

20 readers
3 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
1
 
 
The original post: /r/datahoarder by /u/BrendoVino on 2025-04-06 21:39:15.

FYI: My skill level on this is 3/10.

I'm trying to build out our NAS systems - and optimising for speed.

I'm struggling to find any rack-mount NVME-centric NAS systems, or economical external NVME-centric NAS setups. There's a few, but they're from indie companies, with a price-tag to match.

But then I've found the ASUS Hyper Card - which is basically what I'm looking for - but it's wildly cheaper than dedicated housings.

Is this just where the tech is currently at?

Why wouldn't I just build a 'pc' that's a 'rack' of ASUS Hyper Cards instead of a dedicated Rack-mount NVME setup?

2
 
 
The original post: /r/datahoarder by /u/selissinzb on 2025-04-06 21:10:13.

Hi,

For years I've been using shucked WD Drives but recently the prices of Ultrastar drives have been more gentle on wallet and I want to gradually move towards enterprise drives.

Last few days I spent on reading and watching reviews and it's hard to draw conclusion if those drives are really that loud. I know what to expect from working drive but can someone are they really that loud?

3
 
 
The original post: /r/datahoarder by /u/UltimateDillon on 2025-04-06 20:13:22.

Helloo, I was wondering if I clone a drive using whatever cloning software, does it clone faster if there's less files on it? I know that it clones every sector whether the sector is empty or not, so I have doubts that it will be faster than copying the files that are on there manually. What's the truth?

Edit: Thank you guys, I'm gonna look into CloneZilla

4
 
 
The original post: /r/datahoarder by /u/PM_ME_UR_COFFEE_CUPS on 2025-04-06 19:24:51.

I’ve been using Seagate Exos X18 for years without issues from serverpartdeals. But this Dell branded Exos X16 just clicks about 20 times after it spins up and never shows in the device list.

Is this drive in need of the Kapton tape 3rd pin fix, or do I have a bad drive? I ordered some Kapton tape from Amazon and it’ll be here Tuesday.

Ps I tried scotch tape but it didn’t work. It’s clear so I couldn’t tell if I got full cover over the pin.

5
 
 
The original post: /r/datahoarder by /u/OneAngryFan on 2025-04-06 19:13:58.

Hi there,

I got two old hard drives but no AC Adapters, and I am a bit lost which ones to get.

The first external HD is a San Max HD-337-U2

The other one is a Buffallo HD - HC250IU2-RDE

Any help is highly appreciated.

6
 
 
The original post: /r/datahoarder by /u/talon1324 on 2025-04-06 18:37:04.

Hi, I’ve installed my CT500MX200SSD4 (M.2 SATA) drive, which contains the OS, into a new AM5 motherboard (ASRock B650M PG Lightning), but it’s not detecting the drive. I’ve been reading that the most likely reason is that the M.2 slot doesn’t support SATA, only nvme.

What would be the best way to boot from my drive with the new motherboard, or at least be able to access the data?

Is it recommended to use an adapter?

If so, which one specifically?

7
 
 
The original post: /r/datahoarder by /u/noobshark3 on 2025-04-06 17:06:12.

Hey. I have the netapp 4246 enclosure, with two controllers and two power supplies.

I have a LSI 9300-8E HBA.

This is the picture of my setup. It has the picture of the HBA connection, the NetApp cable connection and the HDD Sled having the light on.

https://imgur.com/a/BMjtf6j

I can't for the life of me figure out why the cable: Mini SAS HD SFF-8644 > Mini SAS SFF-8088 doesn't turn on any LED light in the enclosure.

The HDD Sled turns on its LED light, but the cable doesn't. Also, the cable feels very wiggly.

This is my first time dealing with this NetApp enclosure and I've already searched during the last 4 hours of any tip for the cable, but besides pulling the blue thingy for it to latch and "click" it doesn't really seem like it's entering properly.

I'm using it in the SQUARE entrance, as that's supposedly the one I should use.

Can anyone help me understand what is going on?

8
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2025-04-06 14:54:37.

Hello,

If you were setting up a relatively large array for Windows would you use REFS?

9
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2025-04-06 14:53:37.

Hello,

I can't seem to find this part on Seagate's web page so I'm wondering if it is legit. I may contact Seagate but thought I'd ask here.

10
 
 
The original post: /r/datahoarder by /u/welovett70 on 2025-04-06 12:19:26.

I’m trying to expand my Dell Precision 3630 (i7-8700 CPU)to support 3.5” HDDs larger than 8TB, but I’m running into an issue where drives above 8TB are not recognized in BIOS.

Current Setup:

  • Storage:** 1TB SSD (SATA) + NVMe drive installed

  • BIOS Version:** 2.31

  • SATA Mode:** AHCI (confirmed enabled)

  • Power Supply: 400W 80 Plus Gold PSU

  • Drives Tested: 12TB & 14TB HDDs (formatted with Btrfs on Proxmox)

Troubleshooting Steps Taken:

  • Checked BIOS settings – All SATA ports are enabled, toggled them off/on.

  • Tried different SATA cables & ports – No change.

  • Confirmed AHCI mode – Not running RAID or Intel RST.

  • Drives work fine via USB DAS – But not when connected via internal SATA.

Questions:

  1. Should the Precision 3630 be able to recognize drives larger than 8TB via SATA?

  2. Is this a known BIOS limitation, or could it be a power delivery issue?

  3. Would a PCIe SATA controller bypass this problem?**

  4. Any recommended BIOS settings or firmware updates that might help?

Would appreciate any insights from those who’ve dealt with large HDD compatibility on Dell workstations!

11
 
 
The original post: /r/datahoarder by /u/su-do_nym on 2025-04-06 02:36:49.

Any recommendations for a cloud server with lots of storage space that you can buy a lifetime plan for?

I want to specifically store all my photos on it so I would need to be able to run immich on it.

12
 
 
The original post: /r/datahoarder by /u/T-nash on 2025-04-06 13:43:43.
13
 
 
The original post: /r/datahoarder by /u/SuperCiao on 2025-04-06 09:31:05.

Hi all,

I'm seeking the most robust and verifiable method to copy large video files (ranging from 10 GB up to 200+ GB) to an archival storage setup on Windows 11. Ensuring data integrity and transfer reliability is paramount, as these files are intended for long-term preservation.

My storage configuration includes:

  • 2 Western Digital Gold 8TB internal HDD, formatted as NTFS, dedicated to cold-archival purposes.

In my previous attempts, I utilized Python scripts employing the built-in shutil.copy() function to automate the copying process. However, I encountered challenges related to performance and data integrity:

  • Performance Issues: The default buffer size in shutil.copy() led to slower transfer rates. Adjusting the buffer size improved performance, as discussed in this Stack Overflow thread.Stack Overflow+1Python Central+1
  • Data Integrity Concerns: There were instances of file corruption post-transfer. It's been noted that shutil.copy() may not handle large files optimally, and ensuring data integrity requires additional verification steps, such as hashing.

Given these challenges, I'm exploring alternative methods and have the following questions:

  1. Recommended Tools: Beyond Python's shutil, are there more reliable tools like robocopy, Teracopy, or FreeFileSync that offer built-in verification mechanisms to ensure data integrity during large file transfers?
  2. Verification Practices: Is performing a post-copy hash check (e.g., MD5/SHA256) advisable for large files, or are the verification features in the aforementioned tools sufficient?
  3. Filesystem Considerations: Are there specific NTFS settings or configurations that optimize the handling of large sequential files on WD Gold drives?
  4. Write Caching and Ejection: Should write caching be disabled for these drives, and is it necessary to safely eject the external drive after each transfer session to prevent data loss?
  5. Power Interruption Safeguards: What measures can be taken to protect ongoing transfers from power interruptions, especially when using external USB drives?

My priority is accuracy over speed—ensuring that each file transfer is bit-perfect is more important than the duration of the transfer.

I appreciate any insights, recommendations, or shared experiences regarding best practices for securely and reliably transferring large files in a Windows environment.

Thank you!

14
 
 
The original post: /r/datahoarder by /u/Reasonable-Law2411 on 2025-04-06 07:05:54.

I'm searching for a reliable TikTok HD video downloader that doesn't add watermarks to downloaded videos. While there are numerous options available, I'm interested in finding the best downloader?

Im currently using: https://www.tiktokfetch.me/

15
 
 
The original post: /r/datahoarder by /u/Kazozo on 2025-04-06 06:43:58.

Will be using it for daily regular backup as an attachment drive. Nothing intensive. Regular office work and some slow tormenting on.

HUH728080ALE601

5 Year Warranty Card (probably not applicable? But they included this)

HGST 8tb, Refurbished with 90 day refund/replacement

Ships from : Amazon

Sold by : WorldWide Product Importer

Around 130 USD

NOTE -These HDD is used by Datacenter Servers for about 3 Years period. HDD was refurbished and data wiped with DoD standard. It's fully tested & passed HGST factory diaGnose software test. Since this is heavy duty enterprise HDD with a 2.5M-hour MTBF ratinG.

8TB, 128MB Cache, 7200RPM, SATA III 6.0Gb/s - DesiGned for 24/7/365 Heavy Duty, 2.5M-hour MTBF

16
 
 
The original post: /r/datahoarder by /u/BreadfruitExciting39 on 2025-04-06 06:41:50.

This post is meant to serve as a warning to others like me in the future.

I have had two WD red drives in a Buffalo LinkStation LS421DE, running in raid 1 for quite a few years. I started running out of space, and want to move to a cloud backup anyway (so the raid redundancy isn't as important to me anymore), so I decided to move to just a bunch of drives with no raid array.

Genius me thought "backup the data, shutdown the NAS, pull a drive, boot it back up and delete the array, shutdown and reinsert drive, and I'll have two separate working drives and one will retain all the data".

Turns out this NAS didn't like that. When I rebooted with the 2nd drive reinstalled, everything stopped responding and the NAS went into "Emergency Mode." It took me an hour of messing with it and resetting this & that to figure out that the drives have to be partitioned and formatted from scratch in order for this NAS to recognize them. When I destroyed the array with only 1 drive installed, the NAS repartitioned and formatted that one fine. But it just completely froze up when trying to setup the 2nd drive that still had data.

Hoping to save someone a headache in the future. Just back it up & blow it all up (or buy a better NAS and avoid the headaches altogether).

17
 
 
The original post: /r/datahoarder by /u/Abdel403 on 2025-04-06 04:04:30.

First, please don’t mind my technical jargon, I’m a regular consumer not a pro. Don’t work with and save data daily, just need to have a simple and easy enough way to do this without becoming an expert :)

Here is my situation and my problem (if it is!): I have saved all my personal data (under 1TB) of all sort since years in an external HDD, and just recently bought an external SSD (SamsungT7 shield) as another backup media, ext-HDD would become now the final destination. So, historically, whenever I have modified a file or have new files on my computer, I would transfer them and save them in the ext-HDD, but it’s a slow device and goes to sleep etc, so not very user friendly and not as fast as of working on a computer. So now that I bought a fast ext-SSD, I will use it as a first backup, which have fast transfers with the computer. Then once in a while, I will backup the ext-SSD into the ext-HDD.

My old and conventional method was to remember the location of the modified files and overwrite them in the ext-HDD and sometimes create new folders for new files, using sample Windows copy/paste or drag to move and save stuff on the final backup media. Not sure if there

  1. But, if I don’t want to do that between the ext-SSD and the ext-HDD, and instead of a full copy between the two drives, which will take hours, is there some ways and softwares that will update and re-work the external HDD for only the modified folders and files to match the external SSD ? a program that will just scan the ext-SSD and check what are the difference in folder structures/names and files and only make copy the modified ones and make the new folders and such, comparing file sizes, dates and other parameters to make sure to not touch the exact same ones.
  2. Or is it safer and most efficient just to copy the entire SSD into the external HDD every time, which more likely will take hours.
  3. Do some of those programs have the options to optimize the space on the drives? like defragmenting and do a better grouping and such? I noticed that the HDD actual files size and actual on disk storage size is very different, while the T7 SSD seem to have them very close to each other.

Pleas advice what should I do and what few free softwares are available for both cases?

Thank you!

PS: I’ve put in my notes the name of few softwares that I stumble on over time but never looked into them yet and probably each of them is for different applications, like:

Clonezilla

Macrium Reflect

terabyte unlimited Image backup restore suite

Aomei backupper

Rsync

Freefilesync

syncfolders

robocopy

borgbackup

Veeam Agent

CrystalDiskInfo

Ddrescue

Acronis

CZKAWKA

Carbon Copy Cloner

Super Duper

soft raid

Duplicati

Duplicacy

Raise data recovery

R-studio

Getdataback Pro

ufs-explorer

DMDE

18
 
 
The original post: /r/datahoarder by /u/Appropriate_Day4316 on 2025-04-06 02:40:56.

Original Title: I have WD My Cloud NAS with two 12TB drives bought a year ago as refurbished. The system showed one drive as BAD. After reboot the flag dissapeared and it is now showing GOOD. I have apportunity to RMA and get replacement. What do you think?

19
 
 
The original post: /r/datahoarder by /u/venjah on 2025-04-06 02:40:39.

Hi, I've got a question. Like the title said, I have a 4TB Seagate Backup Plus portable HDD that I've been using as a backup dump for all of my personal files for a few years now, and only recently have I started to pay more attention to my HDD's usage and trying to prolong its lifespan a bit before investing in a new drive in maybe a year or two.

I've seen some posts in this sub regarding keeping external HDD's plugged in at all times, but mine is not a "heavy duty" requires external power source type of HDD like the ones in the other posts, so I'm not exactly sure if the same answers apply. Should I only plug my portable HDD into my laptop when I need to use it and unplug right after use, or is it safe for me to keep it plugged in?

20
 
 
The original post: /r/datahoarder by /u/S4P on 2025-04-06 02:38:13.

Can someone help me and tell me what this noise is? Noise is new and wondering if my HDD is on its way out. Anything else I can check (see below)?

  • Its a ST18000NE000-2YY101.
  • chkdsk /f /r /x was fine
  • 100% health from Hard Drisk Sentinel
  • 1001 power on days; 3,135 stop/start count
21
 
 
The original post: /r/datahoarder by /u/Character_Mobile_160 on 2025-04-06 01:40:48.

I've read in a few threads that 7z is not good for backups, but I can't really remember what the reasoning was. Maybe corruption, although I would think that any file is prone to that which is why I would be backing up anything important on multiple drives instead of just one, but I'm also very new to this field since my hard drives are now reaching their 11 year marks, I think it's long past the time I should be backing things up.

The most important things to me are project files from music production, like Ableton project files, which can be anywhere from 4MB to 2GB each (and there are almost 2000 of them so this whole folder is about 90 GB), along with more folders with just thousands of audio files (about 6000)

I don't often rely on clouds for backups but instead I just get new hard drives and make copies of data on them. But as for moving around these large folders between computers, it would be huge transfers, and 7z can infact compress audio files by a bit. Would it be worth it for these backups or should I just back them up raw? Or is another format better (like tar along with a compression method like xz)

22
 
 
The original post: /r/datahoarder by /u/docnstuff on 2025-04-05 23:03:25.

Hello, I have recently started consultancy.

I have many years dealing with management systems on unorganized servers and I want t pl get away from that pain on my own.

With all the modern Microsoft 365 packages now to my own account.

I would like to get to a flat storage system for my central management system but would also like to do the same for my client.

So my question is what is the quickest and easiest way to remove single files from huge folders within folders within folders? Dragging folder from each project folder will just take forever.

Also is there an easy way to take the information within each file to add to share drive columns.

I would love to have a means to easily get the information I need and take from it what I need. I also believe it be better value to my client that I'm not just spending hours and days just moving data and classifying it.

Any help or assistance would be greatly appreciated!

Thanks in advance

23
 
 
The original post: /r/datahoarder by /u/NadiaN98 on 2025-04-05 21:16:09.

Hey guys. I'm looking for a program for Windows that allows me downloading from youtube and has an extension like the one IDM has that appears on top of each video and allows me to dl a video directly from the different qualities available.

IDM works for a couple of days and then doesn't for a month until it gets updated. I have Jdownloader too but it needs importing cookies and logging in all the time and it's not just as smooth and quick as IDM.

Any help will be appreciated. Thanks in advance.

24
 
 
The original post: /r/datahoarder by /u/Economy-Repair8926 on 2025-04-06 02:38:45.

ive tried all the ways to do it but i cant figure it out

https://web.archive.org/web/20201125075954/http://www.itsaturday.com/

i would be very grateful if someone could

25
 
 
The original post: /r/datahoarder by /u/georgosnero on 2025-04-05 23:10:06.

Hey y'all. I want to download a concert live that's locked behind a paywall. It's a concert live from Zaiko, and I've already paid for the digital ticket a couple of days ago. It's a great live, and I'd like to have it in my personal collection since this band hasn't released any live concert videos, aside for a couple songs.

The problem is downloading it. I have seem a guide here before on downloading it, but have yet to try it myself. I know downloading stuff that's locked behind something is quite complicated, and I'd like for someone to show/guide me into doing it. Thanks!

view more: next ›