It's A Digital Disease!

21 readers
2 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
151
 
 
The original post: /r/datahoarder by /u/Domintoff on 2025-04-10 15:41:43.

Looking for some advice about the cheapest way to get my 14tb hard drive (with all its data) from my pc to my laptop. I've bought an external enclosure for it however it needs to be initialized/reformated to work on the laptop therefore losing my data. Is the best way to rent a cloud storage service upload it then reformat the drive then download from the cloud service again? Is there a cheaper way?

152
 
 
The original post: /r/datahoarder by /u/Nuklr on 2025-04-10 14:07:51.

I recently opened one of my bookmarked pages, https://www.motorsportimages.com/, to find Getty had completely ruined the site by removing and hiding the images it used to contain. The Wayback Machine has some snapshots but it's far from complete.

This might be a long shot but is there any community, tracker or place I can check to see if the website and the almost 100000 photos from old GPs and motorsports history were backed up somehow? I know it would have required someone to scrape the whole site and pull the highest res version of each photo along with the title, description, time and all the metadata that made the site so good.

I'd appreciate any input or tips, this is really niche and I highly doubt there is a complete backup but who knows

153
 
 
The original post: /r/datahoarder by /u/planetwords on 2025-04-10 13:09:52.

Thought this might be interesting and useful to at least someone.

154
 
 
The original post: /r/datahoarder by /u/Wesley192 on 2025-04-09 18:03:12.

I tried my best searching for options to store my data offline, but came to the conclusiom that there are a lot of options all with varying pros and cons - so I figured I’d start a general discussion and share thoughts with people in a similar situation.

Currently I’m generating about 25tb every 3 months, which I store on my 25tb NAS configured in raid5, and have about 161tb of offline storage on external hard drives. Currently I keep buying new ones every 3 months for back-ups and then put it in my safe.

I’ve grown from 5tb every 3 months to 25tb, so my old way of doing it is starting to become a (physical) storage problem.

Any ideas?

155
 
 
The original post: /r/datahoarder by /u/mpaletti on 2025-04-10 08:29:08.
156
 
 
The original post: /r/datahoarder by /u/blarrybob on 2025-04-10 05:08:28.

A friend gave me a new 4TB sas drive from a netapp. It was never used. I added it to my existing sas controller, but I’m unable to pass it though to my truenas guest:

root@home:~# qm set 100 -scsi2 /dev/disk/by-id/scsi-35000039c58013a64 update VM 100: -scsi2 /dev/disk/by-id/scsi-35000039c58013a64 volume /dev/disk/by-id/scsi-35000039c58013a64 does not exist

lshw shows:

Sdb X477_TTCRE04TA07 /dev/disk/by-id/scsi-35000039c58013a64 /dev/disk/by-id/wwn-0x5000039c58013a64

Is there some kind of proprietary netapp lock on drives like this?

157
 
 
The original post: /r/datahoarder by /u/Fabulous_Bluebird931 on 2025-04-10 04:58:03.
158
 
 
The original post: /r/datahoarder by /u/otoko_no_hito on 2025-04-10 04:57:54.

In the light of current events I'm seeing history repeat itself, knowledge is on assault because a few political parties find the truth inconvenient, history shows us this is not new and they'll do their best to "burn" the library.

Our ancestors used to write in clay and stone, so we know much about them, but what about our scientific papers and research? What about all of our accumulated knowledge in digital format we got?

It is in real danger of disappearing into thin air, we are one bad president away from losing staggering amounts of that knowledge, so I would like to start a discussion I have not seen anywhere discussed seriously enough, that is, how could we start to have lots of copies in what I call ultra long term cold storage, that is at minimum 500+ years of guaranteed storage, I got several ideas, but by myself I won't be doing much, I'm not rich so I got limited resources, yet maybe between all of us can come up with something, or at least start the discussion and someone will be able to do just that.

One of my ideas would be to create miniatures using glass, not the fancy Femto second laser that is being used in quartz, I'm talking about something far more dyi, it could be simple engravings for text and images using fiber lasers, which are a lot cheaper and easier to find.

159
 
 
The original post: /r/datahoarder by /u/FancyDisk8874 on 2025-04-10 04:39:13.

i plan to delete my instagram once and for all, and i’d like to have access to my archive and posts as well as the comments on it. it would be nice if i could save chat data too.

160
 
 
The original post: /r/datahoarder by /u/SLJ7 on 2025-04-10 04:28:15.

I'm getting close to filling up my 12 TB drive so need something new. I'm in Canada.

I see that on US Amazon, there is this Seagate drive for $249 for 22 TB, which is lower than all the other prices. There are lots of reviews but I'm not sure if there are any specifically for the 22TB variant.

If you change this URL so it says amazon.ca instead of amazon.com, you get a listing for $364 CAD ($256 USD), but there are no reviews and no size/style variations. It's just a single listing with no reviews whatsoever and a very low price compared to everything else.

Should I avoid this? Has anyone seen something like this before? If it's suspicious, why is it listed along with all the other Seagate drives?

161
 
 
The original post: /r/datahoarder by /u/Defiant_Fix8658 on 2025-04-10 03:40:14.

Hi tech crowd,

I need to get serious about backing up my computer files (documents, photos, etc.) and looking for a reliable external hard drive, probably in the 1TB or 2TB range.

I'm a bit confused about SSD vs traditional HDD for external backup purposes. Is the speed of an SSD worth the extra cost just for backups, or is a reliable HDD fine?

Looking for recommendations for specific models or brands (like Western Digital, Seagate, LaCie, Samsung T-series?) known for reliability and longevity for backup use. Any particular drives I should avoid? Thanks for your advice!

162
 
 
The original post: /r/datahoarder by /u/manzurfahim on 2025-04-10 03:10:42.

After seeing the HDD price increase four times in less than a month, I reached out to one of the popular sellers of recertified enterprise drives, and I was told that the price increase mostly happened because of people panic buying. There are also scalpers and many of the distributors have placed a hold on the inventory.

They are hoping for the tariff negotiations to happen soon so the price will settle back down within a week or two. Panic buying is making things very difficult.

I'm going to wait and see how it settles, I bought 2 x 20 TB two weeks ago, and I should be fine for a month or two.

163
 
 
The original post: /r/datahoarder by /u/TheRubyBerru on 2025-04-10 03:08:03.

I'm relatively new to Data Hoarding and have recently downloaded XML backups of Fandom wiki's. Now that I have them, how do I open them? I would like to mirror the wiki's in HTTrack, but since the wiki's I have have thousands of pages, I'm not sure this would be possible. How would I go about converting or viewing these XML files back as wiki's?

164
 
 
The original post: /r/datahoarder by /u/No_Activity_5919 on 2025-04-10 02:21:33.

I’ve been exploring ways to ensure that digital data can be preserved for as long as humanly possible..and I’m curious about the obstacles others face. Is it issues with hardware longevity, keeping up with technological changes, managing incremental backups, etc? What barriers are there that make long-term storage difficult?

I’d love to hear your experiences and any tips you might have. Thanks in advance for sharing your insights!

165
 
 
The original post: /r/datahoarder by /u/tenclowns on 2025-04-10 02:19:02.

So from the test I have seen it seems to get a bit too hot when loaded with high capacity drives, also the fans need to be on max, which is quite noisy. Did someone try this with case fully stacked with different fans? What temps did you get?

I wish they made this unit with 7 drives and so that air could pass through the drives better for us worried about heat and noise, which is everyone really

166
 
 
The original post: /r/datahoarder by /u/Owls08 on 2025-04-10 01:37:09.

Will Trump's tariffs have a big impact on storage products? I had planned to buy a DAS for expansion in the future, but with the way things are going maybe I should buy it sooner rather than later?

167
 
 
The original post: /r/datahoarder by /u/Interesting-Sir-6842 on 2025-04-10 00:39:42.

Which would be better for backup purposes? I'll be using it to backup my laptop.

168
 
 
The original post: /r/datahoarder by /u/Pinguinina on 2025-04-09 22:56:49.

Hi, I'm attempting to archive information from this page: https://www.bbc.co.uk/radio1/robdabank/tracklistings2008.shtml

When clicking on the "track lists" the website gives "an error occurred while processing this directive" instead of the information desired, from urls formatted like https://www.bbc.co.uk/radio1/robdabank/tracklistingarchive.shtml?081103

However, when using Google, the preview includes parts of the track lists that give an error:

https://preview.redd.it/ius91op43wte1.png?width=697&format=png&auto=webp&s=8c81d998b5da976cf6acf3054276f3b39602b853

Does this mean the information is there and accessible and I just can't figure out how? I've tried Wayback Machine and due to the way the urls are formatted the Wayback Machine either gives the same error or says it didn't archive the pages.

169
 
 
The original post: /r/datahoarder by /u/Lob- on 2025-04-09 22:43:23.

Forgive me for being a complete newb in this area. I recently got a bigger NVME drive and want to transfer the data on it to the new drive. It's not much data and it's nothing terribly important, in this case my Steam library which totals to 1.5 TB. I'm also inquiring because I do intend to backup/copy family photos/videos later on down the road and want to make sure it's done so safely without corruption or loss.

I see many different recommendations ranging from robocopy, teracopy, fastcopy, freefilesync. I narrowed down the software that interested me.

The programs that I'm looking into so far are robocopy, fastcopy, and freefilesync. Fastcopy and freefilesync seems pretty straight foward but if there is anything I should know about those programs before hand I would very much appreciate any tips.

As for robocopy, this is a bit intimidating as it doesn't include a GUI. I did see people talk about choeazycopy but read some people recommend against it cause it causes slow downs? Not sure how accurate that is... let me know if that's just misinformation. In regards to using it via cmd line, what would be the perfect setting I could use (basically copy & paste someone's setting) for the stuff mentioned above? ex. Copying data to another drive without deleting destination drive or Mirroring a drive if I intend to upgrade the storage size.

Appreciate any advice!

170
 
 
The original post: /r/datahoarder by /u/MundaneRevenue5127 on 2025-04-09 22:27:26.

I'm a fan of the metadata files that you can collect with yt-dlp, especially comments, very nice to have when preserving volatile channels. So I had an AI python script made which can convert all of the metadata it creates into a functional HTML file with CSS and Javascript. It works on an entire directory of files.

Preview Image: https://ibb.co/0RbqMt1f

The best feature is probably sorting up to hundreds of thousands of comments (at once) by Longest length, Most likes, Most replies, or alphabetically. I couldn't manage to implement chronological sorting though, maybe it's possible but comment timestamps didn't help. Also it can't play video files; doesn't seem possible with static HTML in this context.

Pastebin Script Link: https://pastebin.com/L7supm6m

Script download: https://drive.google.com/file/d/1FYYIZMkjNzMWEnKcTAeiLYiErJU1cSiz

Example HTML : https://drive.google.com/file/d/1xdhNIBfQiTdviSTzhEbWCZywVk8r4qvC

I'm not going to say this is an advanced thing but I think it looks good for what it is, it took several hours to get functioning/looking the way I wanted, debug, test new stuff. If you wanted you could probably redesign it to look more like the old youtube layout, but it'd take awhile probably, AI can't really one shot it.

Currently it can display basically everything in a fake youtube page with a functioning description and comment section. As well as several buttons to copy metadata, and a few links and tooltips for relevant stuff.

I think this is most useful for archiving videos/channels that could get deleted, I do this proactively with certain channels. So for every video you archive, you could have an HTML file with it to search comments. From what I can tell the HTML files can open directly from Internet Archive, and render it's own page.

The Wayback Machine doesn't have functional comment sections, or archives any comments at all, so this at least is superior in that aspect. Of course, it depends on the day you archive the comments.

Features

  • Visual representation of a possibly deleted video. Title, description, thumbnail (if the video isn't deleted), comments, tons of other info. I tried to get it to play video files/thumbnails in the HTML after its opened, pretty sure its not possible. If the video is deleted, thumbnails won't render because google links are deleted.
  • All comments can be rendered, chronological sorting isn't possible but you can sort by Most Likes, Most Replies, Longest Length, Alphabetically. (This itself could be really interesting on its own to search comment sections). I got all comments on "Stronger" by Kanye to load at once, took a few minutes for 100K comments.
  • Copy channel URL or Channel Handle of the video creator, or any commenter. Clicking a commenter profile picture opens it in a new tab, 64x64 resolution, it looks like a channel thumbnail downloader finds higher quality links though.
  • FakeTube logo, Open the original video link in new tab, and links to beginner-oriented archive tutorial documents I've made (+ other scripts). If you don't want the links there, you could just remove the "tutorial-links-container" and CSS styling.
  • A button to open the original script in a pastebin link.
  • Additional info section that has things like tags, video length, format, and bitrate.
  • Schedule date of some videos (90% sure that's what timestamp refers to), functional description, buttons with hover effects.
  • Functional dislike bar with % ratio tooltip (only if the json file is pre-2022). Very niche application but it works.
  • Verified checkmarks, favorited comments, pinned comments (display "Pinned" rather than at the top of the comments).

I tried getting comments sorted by Newest, but certain jsons files had the exact same timestamp for each comment, while others didn't and you could sort of sort them by date. But no matter what, the exact timestamp (UTC 00:00:00) would be the same for each comment. This is most noticeable in replies, they had to be sorted by most likes which kinda sucks. There is a "time_text" on comments like what youtube has, which is relative to the json creation date, but it's not precise.

Also I couldn't find an uploader profile picture link, unless the uploader made a comment on their own video; if not it displays as "N/A". Commenter profile pictures work just fine though unless they change them. It does rely on google links for images, so if the links are deprecated they won't show up. Couldn't find a way around this.

If something is glitchy, or there's a missed opportunity, I'm open to suggestions. I'm by no means a yt-dlp expert

171
 
 
The original post: /r/datahoarder by /u/Pasta-hobo on 2025-04-09 21:20:00.

It spins down after like 45 seconds. I can't even pause a video off of it without it spinning down and needing to wait like 45 seconds for it to spin back up. and to top it all off, it's externally powered.

it's one of these ones, btw.

172
 
 
The original post: /r/datahoarder by /u/xkcx123 on 2025-04-09 22:15:32.

How will warranties of products be effected by tariffs ?

For example having to send something to Japan, Korea or China for warranty support will there be tariffs.

173
 
 
The original post: /r/datahoarder by /u/ZDRoberts81 on 2025-04-09 18:19:21.

I've got about 10 small SSD drives (like the Crucial X9pro) and add one about every three months from my work and need some sort of case to hold them. I'm looking at getting a pelican style case with foam inserts but that feels a bit overkill? Anyone have any solutions?

I also have older portable 3.5inch drives just in a box and probably should deal with those too...

174
 
 
The original post: /r/datahoarder by /u/Storxusmc on 2025-04-09 17:44:39.

I am currently rebuilding my unRaid server with new Intel 265k, was looking at my hard drives, which are 8tb refurbished enterprise drives. I noticed my oldest one is from 2009, most are marked 2012.

175
 
 
The original post: /r/datahoarder by /u/Storxusmc on 2025-04-09 17:44:33.

I am currently rebuilding my unRaid server with new Intel 265k, was looking at my hard drives, which are 8tb refurbished enterprise drives. I noticed my oldest one is from 2009, most are marked 2012.

view more: ‹ prev next ›