56
God, I wish AMD and Intel could get their shit together.
Happily playing modern games and developing shaders on my AMD GPU. 5120x1440 120 Hz issue free
I wish people would get their shit together and realize they’ve fallen victim to marketing
It's not marketing, AMD sucks for ML stuff. I don't just play games. Everything is harder, with fewer features and less performant with AMD.
The situation is mostly reversed on Linux. Nvidia has fewer features, more bugs and stuff that plain won't work at all. Even onboard intel graphics is going to be less buggy than a pretty expensive Nvidia card.
I mention that because language model work is pretty niche and so is Linux ( maybe similar sized niches? ).
Yeah. Linux boys on AMD are eatin' good.
Really? I've only dabbled with locally run AI for a bit, but performance in something like ollama or stable diffusion has been really great on my 6900xt.
The problem isn’t, that it isn’t great, but that nvidia cards are just better at a given price point, partially thanks to cuda.
And for gaming and general use, my experience in the last few years has been, that nvidia still has the leg up, when it comes to drivers on windows. Never had a nvidia card make any problems. AMD, not so much.
Would still happily trade my GTX 1650 with a RX 6400 because I recently switched to Linux and it’s a whole different world there…
Seriously. AI aside, if you're doing anything 3D-related you're basically shooting yourself in the foot by not going Team Green. The difference in render time/quality is exponentially better. I'd kill to see AMD or Intel pull a Ryzen in the GPU market.
Yeah, the quality of Nvidia pro drivers is a crapshoot though. We've had so many issues, especially with OpenGL, it just isn't funny anymore. Granted, AMD isn't really that much better, but at least the cards cost a fraction and I have more confidence in AMD fixing the problem, than I have in Nvidia.
Success of nvidia now is pretty much the same as the success of Intel back when cisc was losing to RISC(so they became partially risc, lol) and Intel got developers attention because of IBM PC and its clones. So is Nvidia that was chosen by Open AI. Intel competition was quite on par with blue giant(not only amd), but one big player has decided the winner and same with Nvidia since both AMD and Intel and Google have their ai accelerators that are not really worse and even better from time to time. And now after Blackwell Intel presents Gaudi 2, AMD prepares new CDNA generation, Chinese companies create more cost effective solutions, tenstorrent too starts catching up.
Nvidia's and Intel's wins in their respective fields were not really products of their innovations, but rather good cooperation
It's CUDA's monopoly. The entire reason CUDA exists.
The fuckers aren't even shy about it, now, trying to crack down on anyone translating from their proprietary binary format to something that runs on other hardware. Might as well paint yourselves in concentric circles and do jumping jacks in front of the DoJ. "We're being anticompetitive! It's us! Snap us in half or we'll just get worse!!!"
Nvidia has the short term covered, but I'm skeptical they are going to end up leading the AI chip market in about 5 years or so without acquisitions.
Recent research has shown not only efficiency gains but also actual performance gains with binary or ternary weights instead of floats.
This means you don't need FP calculations or matrix multiplication.
It requires being trained from scratch with that architecture in mind, so it will probably be 12 to 18 months before we see leading models with light weights, but once we do the market may go more towards faster and more energy efficient options that don't need to rely on Nvidia's legacy of IP for FP ops.
So while an unmatched king in how things are currently done, the magic phrase that brings any monarch to tears is "this too shall pass."
While I agree with everything you said, I thought the same that after Crypto, Nvidia is done. They did have a dip, before AI jackpot hit.
Once models hit, new chips are bought and installed, it will be another year or two. So they are good for 2-3 years. They are also aware of this issue, I think they are working on CPUs and other businesses, so it won't be total loss. But I agree, sustaining stock at this price level seems unrealistic as of now.
this post was submitted on 01 Apr 2024
56 points (75.9% liked)
Technology
55690 readers
2788 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS