this post was submitted on 01 Feb 2025
59 points (98.4% liked)
TechTakes
1610 readers
112 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Orders of magnitude less, in the super fucking expensive server-farm part, is not going to be offset by being a bit less efficient in the part that runs on your phone. We won't suddenly need new power plants, just to handle local models that push one GPU at a time. Especially when-- it's not like efficiency means your desktop was cruising at 60% power, and is now pushing 100%. It was doing as much linear algebra as it could. With worse models, it'd just do it a bit longer.