this post was submitted on 12 Jun 2023
507 points (99.8% liked)
Technology
1928 readers
7 users here now
Rumors, happenings, and innovations in the technology sphere. If it's technological news, it probably belongs here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There are archives of Reddit history, notably the Pushshift archive & current ongoing Archive Team archive. Much of the data can be searched on the Wayback Machine provided by the Internet Archive, although it's not as convenient.
Would it be possible to somehow mirror the archive as a read only lemmy instance? Like... Funny@oldreddit so that it would be still searchable from lemmy?
I can look into doing this because it sounds like a genius idea. I'll have to work with a friend and see what we can pull together
I'm sure it's possible. Someone would either need to transpile the current data format to match Lemmys', or just build a new front-end for it. Also, it might be considerably difficult to host something like this because there's just so much data. The Pushshift archive alone is 2TB, which is primarily just text.