this post was submitted on 28 Nov 2023
1 points (100.0% liked)

Hardware

33 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 11 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 9 months ago (14 children)

Unfortunately we need to be careful what we wish for. As AI processing becomes more and more popular, if a card like the RTX 4070 had 20 GB vram they would probably all be snatched up by companies to use for AI processing on the cheap, and suddenly 4070 and higher all go for $2000 like the mining craze all over again.

[–] [email protected] 1 points 9 months ago (11 children)

I doubt any big, mainstream western corporations would use GeForce cards for AI, even if they have the same amount of vRAM as workstation cards (and they'd never have the same memory as AI-specific cards such as the H100). Hobbyists will for sure, but they make up such a tiny portion of the market that I doubt it would change the overall demand. Chinese and Russian companies will, I guess, but I don't think that would have the same effect as crypto mining, which has immediate returns without any expertise for individual users, unlike AI applications.

[–] [email protected] 1 points 9 months ago (5 children)

Plenty of people using 4090s tho

[–] [email protected] 1 points 9 months ago (1 children)

Exactly, even though Nvidia removed NVLink it’s still a popular card for deep learning coz it’s relatively cheap for small labs.

[–] [email protected] 1 points 9 months ago (1 children)

NVLink died because PCIE Gen5 can handle incorrect now, no external hardware needed.

[–] [email protected] 1 points 9 months ago (1 children)

PCIe 5.0 cannot do what NVLink does, and NVLink isn’t dead at all.

[–] [email protected] 1 points 9 months ago

NVLink is no longer supported on the Ada Lovelace GPU architecture that powers Nvidia's flagship RTX 4090 graphics. Replacing NVLink is the PCIe Gen 5 standard. Nvidia will use the freed up space from the removal of NVLink to cram in more AI processing capabilities.

https://www.windowscentral.com/hardware/computers-desktops/nvidia-kills-off-nvlink-on-rtx-4090#:~:text=NVLink%20is%20no%20longer%20supported,in%20more%20AI%20processing%20capabilities.

The RTX A6000 ADA also drops nvlink. No idea why the downvotes

load more comments (3 replies)
load more comments (8 replies)
load more comments (10 replies)