We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.
Hardly. There are infinite stories of mistakes we've all made. Kind of you to share the warning.
Well over a decade ago, some complained about their speed, thinking they should see closer to 1Gb/s with their set up. I asked them to look at their ethernet connectors, 4 conductor or 8? These were 10/100, just 4 copper wires, as that was enough to get 100Mb/s.
They replied "I am a moron." No they weren't either. Easy to miss something when there are so many bits of stuff going on.
I transfered about 4TB of data and was annoyed my transferspeeds were not as advertised. I get 10Gbit can be hard to reach depending on system, and this was only mechanical drives, so I had some understanding...but still.
Then I noticed the connection I used was the wrong network, so I used my onboard ethernet instead of my NIC...and my switch was limited to 100mbps bandwidth...
After changing the IP of the network drive it was a big difference
lol this is the data hoarding equivalent of plugging your monitor into your motherboard instead of your GPU
I started doing that when I bought my first PC, and now I have a career in IT. Hope it's a pattern and not a fluke!
My raid 5 hdds bench at 1GB/s but 1.25GB/s sustained wouldnt be easy. Still even 5x more speeds than gigabit is good but not when the orange pi 5 boasts 2x 2.5Gb/s NICs suddenly your hardware feels old. I have a sfp+ switch and a gigabit switch with sfp+ but none of the newer stuff. Sfp+ is cheaper than 10Gb ethernet as the switches cost a lot if you need 24 ports.
My raid 5 hdds bench at 1GB/s but 1.25GB/s sustained wouldnt be easy. Still even 5x more speeds than gigabit is good but not when the orange pi 5 boasts 2x 2.5Gb/s NICs suddenly your hardware feels old. I have a sfp+ switch and a gigabit switch with sfp+ but none of the newer stuff. Sfp+ is cheaper than 10Gb ethernet as the switches cost a lot if you need 24 ports.
I feel like that when I meticulously examine every cable in a new computer build then forget to plug the power cable... /facepalm
I spent hours diagnosing my network over inconsistent speeds. I was stumped, then I finally checked the syslog and found the machine was running out of RAM. Got a bit too liberal with dockers on a 8GB machine. Ordered a 32GB kit immediately while cursing under my breath lol.
Using an older PC as a home server. Couldn't get transfer speeds even close to 100. Fought it for a year or more. One day I happen to catch the resources being maxed out. Eliminated some resources hogs and bam... Transfers went way up. I've tried a couple different Powerline network devices and none have worked very well.
I thought we all use wired 10GB/s network for our NASs.
I'm also updating my WAN from 10Gb/s to 25Gb/s as soon, as I find a mainboard that supports the MikroTik CCR2004-1G-2XS-PCIe.
Most Mainboards have some capacitor on the place, where the 10Gb-RJ45-Port of the card goes.
My winner of winners was flaky connection from our gateway router to my lab. It slowly degraded over time and got to the point I was lucky to get 10MB transfer speeds. Rebuilt my main server 3-4 times trying different things to fix it. Hooked up another server and it could talk to the first server fine. Thought it was a bad switch but everything tested fine until I found one link that wasn’t operating properly. Long story short some type of varment got ahold of my copper run in our craw space and damaged it enough to work but not well.
Im my mind, connections like this are either fine or fubar. I wouldn't have imagined a digital connection behaving like this even in my dreams!
I “think” what was going on was it was a barely working run that was flipping between 100/1000. Both ends at the time we’re unmanaged switches so I didn’t have a good way to check. Because of that I did swap the one to a little 8 port Cisco managed switch so I won’t fall into this trap again.
Had a 1gb speed network.... 1 day speed was 10mb transfer... took me week ti figure out 1 cable connected to device got damaged.
It was super easy to spot. If I taken a min f my time too look.
Powerline in general is a bad idea
Don't feel too bad. I made a nearly identical post 3 years ago, it even has the exact same title: https://old.reddit.com/r/DataHoarder/comments/jdpkm7/im_an_idiot/
It really is amazing how terrible Powerline still is after 20+ years.
There are times where it's the best solution but it's still nowhere close to ideal.
When I upgraded my internet from 60mpbs to 1gbps, I discovered multiple 100mbps switches and poor quality (so limited to 100mbps) cables dotted across my house that had presumably been there for years.
In my company we've been investigating 1Gbps ethernet link between Cisco switches having only 150 kbps data rate.
It was a big ISP with engineers who could decipher IP packets from screen hex dump in their mind (I shit you not) and best Cisco support money can buy.
After few weeks it turned out that disabling auto speed negotiation and forcing 1G rate fixed the issue. And yes - all interfaces claimed that it was always 1G negotiated.
Powerline is the last resort in Networking.
Cable > WiFi > Powerline.
In some cases it works (new cables and within 1 circiut) but usually its more headache than anything else.
But dont worrys we all did shit and wonder why it didnt work.
Just be glad you were not called to a datacenter and started tracing all fibers just to realize that a single stupid uplink is 1 gbit instead of 40 gbit
You forgot the obligatory FedEx truck full of external HDDs hurtling down the highway. 😂
Kind of want someone to re-run the numbers on this with updated storage densities.
And updated line capabilities. China just unveiled a data line with 1.2 TB/s. This is nothing to sneeze at.
I'm going to disagree with you there, it's completely situationally dependent. I tried running a wifi point-to-point link from my house to my detached garage, ran like hot garbage. Replaced the link with powerline, was much more stable and faster.
Right tool for the right job. Well really the right tool is to bury something (preferably fiber) between the buildings, but I'm not made out of money and the power line was already buried!
At my parents house I reused the coax cable for TV. I got a few Moca adapters and I get about 500Mbit/s and they are reliable. It was easier than running Ethernet cable through the walls and outside the house
Yeah, Powerline is horrendous. It’s not only slow AF and sensitive to the underlying power layout in your house, it also causes massive amounts of electrical noise which can mess with receivers, etc.
Where's MoCA fit into this? Haha.
Well, I was ranting about internet speed being lower than advertised after optics installation which should be 1GbE (I got only 300MbE) until I understood that the Asus router I bought a couple of days before that was just 300MbE.