Its worth it for school essays and prawn jesus though.
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
Does the article answer the question of what is the footprint of a prompt?
Basically nothing worth getting angry about
Local models cannot be worse than playing a video game.
There's low-VRAM models for video that approach one frame per second... on the kind of mid-range cards that'd have low VRAM. A 30 Hz clip lasting 10 seconds would take about five minutes. When was the last time you played a really fancy-looking game for less than five minutes?
Now creating the models, yeah, that's still lumbering giants burning money. But mostly thanks to Jevon's paradox. How many watt-hours are needed per hand-wavy unit of training has gone down - so they do a lot more of it. And the result is that laptop-sized models today beat datacenter-sized models a year ago.
And the result is that laptop-sized models today beat datacenter-sized models a year ago.
that's hardly believable. do you have any statistics on this? is this some special edition of a heavy, high performance gaming laptop, with an external gpu attached, and a datacenter consisting of 2 racks almost filled to half?
It is mainly due to the orders of magnitude advances in bullshitting people about AI's capabilities.