this post was submitted on 22 Dec 2024
523 points (96.1% liked)
Technology
60324 readers
3243 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
"The enormous costs" were optional, and driven by greed. This latest neural-network revolution happened thanks to consumer video game hardware. Then the big boys got involved and pushed unreasonably large models, partially because they figured that's where the magic would happen... but partially to justify all the data they'd need to scoop up indiscriminately... and partially because going big limited competition.
Google themselves proved this was not necessary. Remember the AI that could beat any human at Go? Well, they built a smaller model as a blank slate, and just had it play games, and it quickly got better than the big news-worthy AI. Then they built an even smaller model, and made it do a bunch of games instead of just Go, and it still got better than either previous AI, at Go.