Data Hoarder

170 readers

1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 1 year ago

MODERATORS

[email protected]

Efficient Upload and Cloud Backup? (alien.top)

submitted 1 year ago by [email protected] to c/[email protected]

4 comments fedilink hide all child comments

My very small company (think me and one other person) collects video data for scientific analysis. We typically put the videos on external hard drives for each survey we do. A typical survey will run about 4TB in size. We always make a back up external drive so that we have two copies in case of loss etc. We do at least a dozen surveys a year.

We would like to back all of this up in the cloud. We will need to access the videos from the cloud from time to time but not on a frequent basis.

So first question, what do you fantastic data hoarders recommend as a good cloud storage service?

Second question, given the sheer size of the project, uploading from my business internet account (Spectrum/ northern Michigan) seems like a Sisyphean task. Can anyone recommend any way to increase upload speed (I am on max local program) or if there is a service that will upload rapidly for me if I send them hard drives?

Thanks in advance. Sorry for rookie questions.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 1 year ago

Well, at that scale, price is a concern.

With limited outflows, S3 or Backblaze might be a good option.

I personally use enterprise Google workspace account (12 bucks per 5TB/Month, unlimited outflow). For uploads, I have custom software that does partial uploads to Google Drive correctly. There definitely are others.