this post was submitted on 10 Jun 2023
95 points (99.0% liked)

Technology

1928 readers
7 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

One of Spez's answers in the infamous Reddit AMA struck me

Two things happened at the same time: the LLM explosion put all Reddit data use at the forefront, and our continuing efforts to reign in costs...

I am beginning to think all they wanted to do was getting their share of the AI pie, since we know Reddit's data is one of the major datasets for training conversetional models. But they are such a bunch of bumbling fools, as well as being chronically understaffed, the whole thing exploded in their face. At this stage their only chance if survival may well be to be bought out by OpenAI...

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 18 points 1 year ago (7 children)

Reddit data is public and can be easily web scraped. Reddit doesn't own it. Spez is just throwing random memes in to distract people.

[–] [email protected] 4 points 1 year ago (6 children)

I am sorry but you don't know what you are talking about. These things are regulated by legal documents, you don't just wake up on morning and say "trust me bro, their data is public"

If you go and read their TnC's it explicitly statea that scraping is forbidden without prioir written consent. They only allow access to their data via APIs, which of course they charge for

The fact that it can be easily scraped it's neither here nor there, if they catch you they can sue you

[–] [email protected] 1 points 1 year ago

Unless I'm mistaken and something is different, this hasn't been a problem for tools like newpipe, YouTube vanced, and fritter.

load more comments (5 replies)
load more comments (5 replies)