It's A Digital Disease!

This is an automated archive.

The original was posted on /r/datahoarder by /u/dominator9947 on 2024-01-23 18:27:55+00:00.

I'm new to these cards so keep any suggestions simple.

Having used hardware RAID in the past & lost all my data, I progressed to Freenas ZFS but lost confidence in that when ZFS randomly reported suspicious HDD problems which couldn't be ratified by HDD manufacturers diagnostic software (seagate seatools etc).

My current backup solution is to backup my main Windows 10 Pro x64 PC to another Windows 10 Pro x64 PC that is using Stablebit Drivepool & then backing up this 2nd PC to another Windows 10 Pro x64 PC, also running Stablebit Drivepool. I use Stablebit Drivepool with x2 duplication (mirrored) & all seems to work well. Each of the two backup PC's have 10 HDD's arranged as 5 mirrors.

My biggest problem is running out of SATA ports, so I'm using 4-port SATA PCIe adapters (Marvel chipset) on my 2 backup PC's, even though they don't come highly recommeded. My main PC will not recognise any of the 4-port SATA PCIe adapters (Asus ROG STRIX B450-F Gaming II mobo). It was for this mobo I bought the Intel RES2SV240 as a possible solution without realising it had to connect to a SAS PCIe HBA.

My question is, can I buy a non-RAID SAS PCIe HBA (or a RAID HBA card not configure for RAID use) to connect to the Intel card in a non-RAID mode; if so, what SAS PCIe HBA would you recommend?

All suggestions will be gratefully appreciated

This is an automated archive.

The original was posted on /r/datahoarder by /u/danielrosehill on 2024-01-23 21:31:29+00:00.

For those of us into optical media, etc:

I notice that the lion's share of production seems to have shifted over to Asia over the past couple of decades.

This got me wondering: for those of closer to Asia than the US, is there any way of purchasing optical media directly from China etc? (If Verbatim is CMC etc ... is there really any difference?)

I'm familiar with Aliexpress but they only seem to have a couple of products (mostly Ritek stuff).

Thought I'd ask and post here on the long chance that there are other obscure marketplaces in places like Japan, Taiwan etc that might sell at the consumer / non-wholesale level.

TIA

This is an automated archive.

The original was posted on /r/datahoarder by /u/AnticrombieTop on 2024-01-23 21:16:13+00:00.

TL;DR - Suggestions for an image-based interface to an attribute-rich collection.

I've been subscribed to around a dozen Patreons for the past few years and amassed a dozen or so Tb of 3D models. These are released in 'sets' each month, and include a collection image, an image for each individual model, and various files of the 3D model. So the structure is:

_ Patreon

_ _ Month & Name of Release (Represented by a "Collection Image")

_ _ _ Model (Represented by an "Individual Image")

_ _ _ _ [everything under here can be a compressed zip file]

I'm looking to add category features to the individual models ... between 18-20 different attributes ... with the ability to browse the sets or individual models visually (a pinterest-style wall of photos), with filters for each attribute.

WHAT I'VE TRIED

- Adobe Bridge: Almost works, however the attributes are lost when moving files or renaming folders. (data not persistent to object). No way to automate that I have found; so quite a bit of manual entry that is not user-friendly.

- Photo Organizers: Most limit attributes to a single tag (and not include sub-division of attributes), and focus on attributes that are in the metadata of the collection or 3D model photo, such as date taken, gamma, etc...

- Custom WordPress Website: Build out my own using a stock template with the exact needs I was looking for! But have to import all the photos, tag them, etc. instead of just pointing it to the storage nas. Now... I got creative and auto-imported xls sheet conversions with the attribute data, but one small fail in the conversion sheet and it would break the db, so just too risky.

An example of the attribute stack:

_ Genre [sci-fi, fantasy, modern]

_ Category [character, creature, environment]

_ _ Character [elf, human, orc]

_ _ Creature [plant, giant, elemental]

_ _ Environment [swamp, mountain, winter]

_ Style [Holiday, Draconic]

So anyway; figured that 3D printing has been popular long enough now that data hoarding is becoming a problem and you fine folk seem to have some brilliant solutions to similar problems.

Any thoughts are appreciated!

This is an automated archive.

The original was posted on /r/datahoarder by /u/NoReply4930 on 2024-01-23 20:45:44+00:00.

All

Just built out a new digital audio workstation for 2024 and have a quick question on "best practices" for using either a SSD OR NVMe for data storage.

This new DAW is Windows and it has the usually compliment of internal drives (System, Data, Libraries and Samples).

The Data drive is my standard (redirected) storage spot for the Windows special folders (Docs, Downloads, Photos etc) by also houses all my audio work in progress (Studio One songs, voiceover, radio spots etc).

I have a 2020-era 500 GB Samsung 860 EVO (SSD) which has served me well in addition to a 2021-era Samsung 970 EVO Plus NVMe (also 500GB).

Wondering what the pros and cons are to each for this basic data use case - speed notwithstanding - since the NVME is easily 5 times faster.

But reading and writing typical audio in Studio One does not require the sort of speed a typical Gen3 NVMe is capable of.

One real pro that I can see to the SSD vs the NVMe - is that is very easy to disconnect without removal - if I need to do something drastic like reinstall the OS or something - where the NMVe requires more work to get a drive out of the way.

I need to nail this down and ensure the choice is sound for the next 3 years when I do it again.

Appreciate any intel from the field.

This is an automated archive.

The original was posted on /r/datahoarder by /u/rafaeltrenton on 2024-01-23 19:15:34+00:00.

Hey Everyone,

I'm shopping for a new HDD, to use it mostly for archiving (Movies, roms, isos, app backups, etc.) so I'm not super concerned about read/write speeds as I'm not planning on using this on a daily basis, just copy everything over, and leave it as it is just adding info from time ot time...

I'm thinking about getting a 6TB or 8TB drive, and i've narrowed it down to either getting a CHEAPER Seagate Barracuda or a slightly more expensive WD Black performance drive...

Any thoughts? pros / cons on each? any other option worth for around the same price (200-250 usd tops)?

This is an automated archive.

The original was posted on /r/datahoarder by /u/IM_not_clever_at_all on 2024-01-23 18:14:26+00:00.

There really is an /r for everything, what a time to be alive!

I am trying to come up with some options for my company's surveillance camera archiving needs. Our new system is going to generate a tremendous amount of data and we will need to keep the footage for about a year. Our exterior cams have already been used in 3 active police cases. We estimate the total storage needs to be about 400TB (60 days generates around 60TB).

Do we build our own little (hah) Raid0 rig? This is archive only so speed isn't the priority, just space and redundancy to account for drive failures. If the archive unit is down for a few days, not a big deal. Any suggestions?

Would it make any sense to just increase our Dropbox space? We currently have about 120tb.

Thoughts; prayers?

Thanks!

This is an automated archive.

The original was posted on /r/datahoarder by /u/Varaldar on 2024-01-23 17:55:37+00:00.

I'm trying to set up some drives to share some data with friend groups and their friends and interested folk at cons. Everything should fit on 16GB but definitely on 32GB.

I'm wanting to find a good balance between price and reliability. Main concern would be physical durability of the parts and not getting to hot in a larger, thicker enclosure than it came in but the heat thing is fine if it won't damage the electronics or the resin it's in. I know some ones have durability issues or mislabel the actual size of the drives

Looking to buy 50-100+ at a time

would prefer options for both standard USB drive size and those really small ones that are about the size of wireless mouse adapters.

This is an automated archive.

The original was posted on /r/datahoarder by /u/anonymous_2600 on 2024-01-23 17:43:52+00:00.

need help or at least some discussions

This is an automated archive.

The original was posted on /r/datahoarder by /u/RaspingHaddock on 2024-01-23 16:52:17+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/becameapotato on 2024-01-23 16:35:58+00:00.

I want to backup around 100 GB photos and videos of my baby niece, but I heard external drives can break down in years, so I decided on DVD burning since it’s not too expensive and my old laptop’s drive D still functions. However, for some reason the burn process fails at the verification stage. I’ve used the native Windows “Burn” option, imgburn and Ashampoo but keep getting the same results (3 discs turned unusable junk). For now, I selected the “Use blank CD as USB” option and just copypasted the files into the disc.

My question is, will the data last long/record properly if I used the disc as DVD, or will it erode faster if I didn’t burn it?

I do have some discs that I used as a USB and it still reads 5 years later, but I want to ask if there are other Redditors here who used the same method and their results in a longer timeframe.

Thank you in advance.

Used: hp DVD +R double layer 8.5 gb, a 2016 Acer Aspire, and for storage the discs will be kept in plastic cases

(also saved the pics on Google Drive/Photos and a Sandisk thumb drive)

This is an automated archive.

The original was posted on /r/datahoarder by /u/Addyctive on 2024-01-23 16:31:54+00:00.

I have an old 8tb seagate drive that was encoded with NTFS when I first bought it. I shipped with a single-device license for Paragon NTFS for Mac which allowed me to use it with moth my mac and my windows pc. Now, I’ve got a new mac, but the paragon software only works on my old mac. Is there any other software that I can use to run NTFS drives on mac. I have since bought a few more drives that are exFat encoded, so they don’t have any issues. It’s just this one drive that I need to be able to write to without having to power my old 2016 mac.

This is an automated archive.

The original was posted on /r/datahoarder by /u/barcellz on 2024-01-23 16:29:46+00:00.

I don't know if I'm mixing things up, but from what I understand, defragmentation is to put files that are scattered together, which would favor sequential reading (which could be 5 times faster than random in my tests with some memories), but as crucial state, you dont have to defrag a disk because it would not make difference in terms of speed. So if dont make difference in speed why so slow compared to sequential ?

This is an automated archive.

The original was posted on /r/datahoarder by /u/StanTheDryBear on 2024-01-23 16:17:49+00:00.

Certain this is a noob question but:

I've got a media NAS situation going with a small mini pc. Because it's mostly just TV Shows and Movies that I'm sharing within my own house, I'm not running any real redundancy (a few less common movies and shows are backed up to an actual RAID for safety).

In anticipation of the worst case that one of the SSDs just randomly went kaput, I'd like it if I somehow would have a backup of the metadata of what was on it. Something that would at least give me a "shopping list" for the shows and movies I'd have to replace somehow.

This could be as simple as a file that saved the directory trees of the SSD, but could also be something a bit more robust if that's inconsequential to implement.

Ideally, this would be something that's also backed up automatically to the actual RAID storage on the network.

Any thoughts on a tool or script to do this?

This is an automated archive.

The original was posted on /r/datahoarder by /u/jersey_emt on 2024-01-23 14:53:59+00:00.

Archive.today (and all its other domains like archive.ph and archive.md) was working fine for me yesterday. Today, however, it is bringing me to a CAPTCHA that goes back to itself when completed. This is the exact same behavior it was showing for several months the last time it was down.

Hopefully it will be back up again quicker this time.

This is an automated archive.

The original was posted on /r/datahoarder by /u/JohnBalvin on 2024-01-23 14:31:03+00:00.

Hello everyone, with the recent announcement of vbox7 shout down, I created a bot so you can download the videos on your machine

I already deployed to lambda you can test it:

This will give only the final video url, I didn't deploy the full video download because the bill will increase a lot if I do it, but you can implement it yourself

source:

let me know what you want me to add to to the bot

Thanks

This is an automated archive.

The original was posted on /r/datahoarder by /u/danielrosehill on 2024-01-23 14:09:46+00:00.

This is an automated archive.

The original was posted on /r/datahoarder by /u/ki-rin on 2024-01-23 13:34:03+00:00.

I always read about how SSDs are much more reliable and less probs to failure than traditional hard drives, and theoretically that makes sense. But what has your personal experiences been?

Because for me, I've rarely had a mechanical drive fail. Maybe twice over the last 20 years.

But I've had 3 SSDs either fail or degrade severely over the last 2 years. Granted, they are from less reputable brands (2x suneast, 1x adata), but even my Samsung has slowly degraded to about 70% health over a couple of years.

Am I unlucky, or are SSDs not really as reliable as they've been made out to be?

This is an automated archive.

The original was posted on /r/datahoarder by /u/brainmuad on 2024-01-23 13:27:14+00:00.

I have my Normal Home/Work computer with 10Tb of drives

i recently bought 4X4TB Hdd's. and i also have other hard drives lying arround.

Now i wanna install 3X 4TB into my machine and make everything else for backup.

How can i do this?

Should i create a Nas server? or manually backup to those drives once a month?

I'm thinking about putting all the other drives in my second computer and share them with my main computer via network and schedule a task to copy files to those drives once a month? i have to turn the computer manually once a month to do the backup and shut it off

Or Should i create a nas with truenas and raid 6 and scheduale a backup to that nas(im afraid this may be slow)

How should i set this up please?

This is an automated archive.

The original was posted on /r/datahoarder by /u/Bluemoonroleplay on 2024-01-23 12:26:22+00:00.

I wish to copy 500GB of data from one SSD to another

The problem is that the new SSD was not even taken out of the Amazon box for 6 months. Is it safe to transfer all my data to this new one?

Btw old SSD was regularly plugged and used

Will it start working well after this 6 month sleep?

SSD is WD My passport 1 TB, both old and new

This is an automated archive.

The original was posted on /r/datahoarder by /u/Economy_Plane7497 on 2024-01-23 12:18:54+00:00.

Helloo, I'm looking for advice for this or just to be pointed in the right direction would greatly be appreciated. As requested by higher ups they would like to also have a external drive to manually backup their servers/ files on a biweekly basis. Using two drives to store the data.

We are running windows server 2019 and do not need much space at all, only 2-5TB of storage. My question is, does anyone that have more experience than me have any suggestions for this? Is there a certain device I need? I mean what's stopping me from connecting any external device and using windows backup to copy said backup to there? Or any tips when comes to backups is welcomed.

A little background. I've done a good amount of research on this, I talked to WD and after 3 long conversations of them suggesting only internal drives and not explaining why their other products wont work I gave up. I noticed a lot of other devices have similar issues with being disconnected randomly, getting corrupt, and dying after a short 3 months. Thank you to everyone who rates this and leaves feedback

Sorry for the repost. It took like 16 hours to post the first time...

This is an automated archive.

The original was posted on /r/datahoarder by /u/secon25 on 2024-01-23 12:05:02+00:00.

Both are MKV.

The first is:

h.264, 1280x720, bitrate 3328 kbps, size 1.4 GB

The second is:

h.265, 1920x960, bitrate 1508 kbps, size 800 MB

Which one has better quality? I would say the h.265 but I read that h.265 is better than h.264 only if they are at the same bitrate. In this case the h.265 file has not even half of the h.264 file's bitrate, does it means that the one with better quality is the h.264?

This is an automated archive.

The original was posted on /r/datahoarder by /u/fixednametag on 2024-01-23 10:42:27+00:00.

So I want to download this directory with containing music files. I've been testing HTTrack Website Copier to do this but somehow I seem to be an idiot. Why isn't this working?

This is an automated archive.

The original was posted on /r/datahoarder by /u/Bluemoonroleplay on 2024-01-23 11:36:10+00:00.

I have an SSD card with 500GB of pure treasure. If it dies then my soul will die.

I purchased and started using it in May 2021. Official warranty is 3-5 years but how many years can I safely keep loading and using it before I transfer all the files to another SSD?

Tell me your personal opinion on number of years I should use it before transferring files.

Link to my SSD:

This is an automated archive.

The original was posted on /r/datahoarder by /u/redsealsparky on 2024-01-23 11:08:49+00:00.

Not sure if this is the right place to ask but I'm sure you folks have a good idea.

I've taken various backups of my phones through the years, and I'm sure there are many duplicate files and get rid of them. Basically, I'd like to organize them by file type: video, photo, or text. Ideally some sort of referance to how they were originally from. Is there a program that could streamline the process?

Thanks in advance for your input.

This is an automated archive.

The original was posted on /r/datahoarder by /u/FreneticFrench on 2024-01-23 10:41:16+00:00.