this post was submitted on 29 Sep 2023
436 points (93.4% liked)

Technology

59719 readers
2311 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Authors using a new tool to search a list of 183,000 books used to train AI are furious to find their works on the list.

you are viewing a single comment's thread
view the rest of the comments
[–] mindbleach 5 points 1 year ago

Of course books were used - and why not?

These are English-language models. They're trained on an English-language corpus. Ideally, the entire history of published works. They're in public, for public consumption. That's what "published" means. Nobody broke into an author's house to steal their secrets. The machine that writes is skimming the whole library to find out how to write gooder.

If they used a literal library - shelves full of dead trees - would people still insist the authors were never paid? Are we supposed to pretend a robot scanning a book a thousand times is fundamentally worse than a hundred people borrowing it? I guarantee you each human got more out of it. These stupid robots have to plow through an entire shelf just to figure out what "fantasy" means.

The more works we shovel into these things, the less each individual work counts. The model does not get bigger. Each work's unique impact shrinks as statistical patterns get generalized.