this post was submitted on 26 Jul 2023
43 points (95.7% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

53779 readers
533 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder


💰 Please help cover server costs.

Ko-FiLiberapay


founded 1 year ago
MODERATORS
 

Hello [email protected]

I intend to upload an archive of a website I scraped for the last few weeks. The torrent is about 4 TB large and contains 400000 folders which in turn contain 40 .jpg's on average (plus some metadata).

Should I just create the torrent with the files as they are right now, or should I put the individual folders in archives (or maybe even the entire torrent?)?

Thanks in advance

you are viewing a single comment's thread
view the rest of the comments
[–] cesium 6 points 1 year ago (2 children)

Makes sense. What about individual folders? I'm concerned that the massive amount of small files could slow down the download quite a bit. Unfortunately, I'm not too familiar with the BitTorrent protocol, so I don't know if this would have an impact.

[–] [email protected] 14 points 1 year ago

Small files don’t impact BitTorrent transfers. They’re sent in pieces of a fixed size, and those pieces can contain multiple files.

[–] [email protected] 2 points 1 year ago

Depends on final size of the folder zips. 20-30mb? Sure. 200-300? Nah.