208
this post was submitted on 03 Dec 2024
208 points (97.3% liked)
Technology
59770 readers
3095 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I always wondered who they were making those mid- and low-end cards with a ridiculous amount of VRAM for... It was you.
All this time I thought they were scam cards to fool people who believe that bigger number always = better.
Yeah, AMD and Intel should be running high VRAM SKUs for hobbyists. I doubt it'll cost them that much to double the RAM, and they could mark them up a bit.
I'd buy the B580 if it had 24GB RAM, at 12GB, I'll probably give it a pass because my 6650 XT is still fine.
Don’t you need nvidia cards to run ai stuff?
Not at all
Nah, ollama works w/ AMD just fine, just need a model w/ enough VRAM.
I'm guessing someone would get Intel to work as well if they had enough VRAM.
Also "ridiculously" is relative lol.
The Llm/workstation crowd would buy a 48GB 4060 without even blinking, if that were possible. These workloads are basically completely vram constrained.
Like the 3060? And 4060 TI?
Its ostensibly because they’re “too powerful” for their vram to be cut in half (so 6GB on the 3060 and 8GB on the 4060 TI), but yes, more generally speaking these are sweetspot for vram heavy workstation/compute workloads. Local LLMs are just the most recent one.
Nvidia cuts vram at the high end to protect their server/workstation cards, AMD does it… Just because?
More like back in the day when you would see vendors slapping 1GB on a card like the Radeon 9500, when the 9800 came with 128MB.
Ah yeah those were the good old days when vendors were free to do that, before AMD/Nvidia restricted them. It wasn't even that long ago, I remember some AMD 7970s being double VRAM.
And, again, I'd like to point out how insane this restriction is for AMD given their market struggles...