this post was submitted on 04 Dec 2023
0 points (50.0% liked)

Data Hoarder

24 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 10 months ago
MODERATORS
 

In the past, I have used a USB to transfer a few video files from one computer to another. This time I have over 1 terabyte of movies and shows I'd like to transfer. What is the best method?

I know it will take a very long time

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 9 months ago

USB 3.1 Gen2 is hard to beat. 10Gbps. But for HDDs the HDDs themselves will be the bottleneck. For sustained file transfers, perhaps no more than up to 3Gbps, even if installed in the same PC. Good SATA SSDs may manage closer to 6Gbps. NVMe SSDs are likely to saturate USB 3.1 Gen2. Then PCI-e directly between installed drives is the fastest. Normal cabled network is only 1Gbps.

File transfers to/from external multibay USB DAS can be done in parallel, involving multiple HDDs, and come close to saturating 10Gbps USB3.1 Gen2 speeds.

Then there is thunderbolt.

Start a rsync transfer when you go to bed. In the morning it will most likely be done.