this post was submitted on 28 Jan 2025
385 points (98.0% liked)
Technology
69946 readers
3534 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Smaller and more local is how this was always bound to go.
Mainframes have never been a good idea. The only sensible applications for computers the size of a building are where one task needs the whole computer. Accessing a slice of that, from a lesser machine, is rarely more useful than letting the lesser machine flex whatever power it has. Almost never, if they can all access a dumb server.
LLMs started on consumer video hardware. The giants in this specific field went big because it was the only advantage they could press. They knew, once it shifted down to more-efficient models that any desktop or phone could run... they were fucked. And here we are.
It won't go much better for DeepSeek, either. They've fucked themselves by implementing the blatant censorship everyone expects and laughs at - so right out the gate, people are modifying their models. There's not going to be any one country or company that supplies a ready-to-go thingamajig that everybody uses. It's gonna stay weird and democratized for a good long while.