Data Hoarder

170 readers

1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago

MODERATORS

[email protected]

Wanting to get to 100TB usable (alien.top)

submitted 11 months ago by [email protected] to c/[email protected]

11 comments fedilink hide all child comments

Hello all, as the title says, I’d like to get to 100TB usable capacity. My current setup is 6x 8TB WD Reds in a RAIDZ2 array under TrueNAS. Usable is about 25TB give or take.

I have roughly $1500 to spend to make this happen but that must include the cost of a new case and drives. Current case is a Node 804 which will be retired. Current mobo is a Supermicro X9SCL with a E3-1220 V2, 16GB of RAM (will upgrade to 64 after this storage upgrade). LSI HBA but can’t remember the model off the top of my head.

Looking to move to a CSE-846 or 847, but not opposed to a more storage dense solution with an 826/827 or 836/837.

I’d like to keep the current drives for now but I’m not opposed to other options. I’m thinking adding either 2x RAIDZ2 arrays with 10TB drives or 1 with 20TB drives.

Does this seem reasonable or feasible for this price range? I’ve found manufacture refurb 10TB drives on eBay but I’m not sure of quality or reliability of seller.

Open to any and all suggestions.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 11 months ago

I looked at those cases, ended up going with this because easier to expand and hte PSU size:
Can find them for less elsewhere:
https://www.amazon.com/gp/product/B095YMXW1K/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1

Have a look at these HDD's, I have seen them as low as $150. i run 20 of them right now, some have 3 years run time now. Been very happy with this vendor, usually only a few hours of runtime:
https://www.disctech.com/Western-Digital-UltraStar-DC-HC530-WUH721414ALE604-0F31156-0F31284-14TB-3.5-7.2K-RPM-512e-SATA-6Gb

Storage type:
If you need the speed, stick with ZFS.
But it should depend on the data and how risk averse you are (how easy to replace the data is). I started all ZFS, now I use this method:

Unraid Array. For easily replaceable media, like movies. (Where I have a list and can easily re-download/upload) I use only the Unraid Array for that. Mainly for data that is write once read often.
Downside:
Unraid write speed is slow. No scrubbing.
Upside:
only the 1 disk that has the data spins up. This saves me about 180-200W of power and lots of wear on the drives.
It's also very storage efficient, I only run 2 parity disks with 20 drives. I wouldn't do that on a regular raidz. But with unraid data lives on each disk, so you don't loose the entire array if you lose more than 2 disks. This changes the risk math.

Then for all my critical data, that I need ZFS speed and scrubbing for, I setup a raidz1 pool with 4x Intel P4510 4TB. (Home pics/media)
Those I got for $200/pc new on eBay.