this post was submitted on 29 Sep 2023
436 points (93.4% liked)

Technology

59689 readers
3200 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Authors using a new tool to search a list of 183,000 books used to train AI are furious to find their works on the list.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 1 year ago (2 children)

Generally they probably bought the books they read though.

If George RR Martin torrented Tolkien, wouldn't he be infringing on the copyright no matter how he subsequently incorporated it into future output?

I completely agree that the training as infringement argument is ludicrous.

But OpenAI exposed themselves to IP infringement by sailing the high seas in how they obtained the works in the first place.

I hate that the world we live in is one where so much data is gated behind paywalls, but the law is what it is, and if the government was going to come down hard on Aaron Swartz for trying to bypass paywalls for massive amounts of written text, it's not exactly fair if there's a double standard for OpenAI doing the same thing in an even more closed fashion.

But yes, the degree of entitled focus on the premise of training an AI as equivalent of infringing is weird as heck to see from authors drawing quite clearly from earlier works in their own output.

[–] [email protected] 3 points 1 year ago (1 children)

I have to assume that openAI also paid for the books. if yes then i consider it the same as me reciting passages from memory or coming up with derivative text.

if no, then by all means, go after them and any model trainer for the cost of one book.

Asking an LLM to recite an entire novel isn't even vaguely a thing yet.

[–] [email protected] 3 points 1 year ago* (last edited 1 year ago)

Well, here's straight from one of the suits against them:

"The OpenAI Books2 dataset can be estimated to contain about 294,000 titles. The only 'internet-based books corpora' that have ever offered that much material are notorious 'shadow library' websites like Library Genesis (aka LibGen), Z-Library (aka B-ok), Sci-Hub, and Bibliotik. The books aggregated by these websites have also been available in bulk via torrent systems."

I'm not even sure how they would have logistically gone about purchasing 294,000 books in bulk in digital form to be fed into training. Using the existing collections seems much more likely, but I suppose we'll see what turns up in litigation.

Also, the penalty for downloading copyrighted material if willful infringement is up to $250,000 per work. So it's quite a bit more than the cost of one book on the line...

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

God that Aaron/jstor thing makes me see red every time. Swartz was scraping jstor to publish it for the benefit of everyone, openai is doing it to make billions of dollars. Don't forget who the bad guys are (and donate to sci-hub)