This is an automated archive.
The original was posted on /r/datahoarder by /u/sebsnake on 2024-01-22 05:37:39+00:00.
I'm a small hoarder, currently sitting at 3TB on a 16TB pool (mostly small files < 20MB) and a larger pool in the 40TB (used) area. Using truenas, the larger pool is raidz-2 with 8x12TB drives 1vdev and the smaller 7x4TB drives 1vdev... I need to optimize this (mostly for power consumption and noise) and need to move the data to my backup device (which I haven't kept in sync for about a year... -.-)
So, what is your way to move large amounts of data to another device, hardware wise? I currently only have 1Gbit NICs, so I'm capped at 100MB/s although the drives could probably give at least a little more. Is there some reliable usb-to-usb solution, or some good WiFi usb NICs someone could advise to me for wireless transport? Or even 2.5Gbit usb NICs that won't break under this load? Are these reliable for larger amounts of continuous transfer?
Bonus question, halfway related: if I do setup truenas anew, is there some way to have a single pool being offline while the system is running, just doing regular scrubs and checks on it? Because than I would do this as a secondary backup, where I could internally move files back if something breaks in the future.