this post was submitted on 20 Nov 2023
1 points (66.7% liked)
Hardware
47 readers
1 users here now
A place for quality hardware news, reviews, and intelligent discussion.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I believe the M2 Max gpu is at the level of a 4070ti at best, but the larger issue is not many tools support metal for compute. On the other hand, all memory is shared on the mac so you (theoretically) get up to 192gigs of video memory, along with the neural engine for basic inferencing and matrix extensions on the CPU.
Essentially, the max is simultaneously excellent and falling behind in different industries, but you won't know until you optimize and test your software for the specific usecase, and after that you're beholden to whatever hardware puts out
Cuda is well supported and nvidia/amd scale well for different applications, unless apple picks up their software I don't think the hardware matters much