this post was submitted on 25 Aug 2023
22 points (100.0% liked)

LocalLLaMA

2274 readers
3 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
SkySyrup
pax
noneabove1182
22
Is there a good reason why AMD APUs just aren't used with massive amounts of (V)RAM just like the Mac M2 is? (lemmy.ca)
submitted 1 year ago by [email protected] to c/localllama
14 comments fedilink hide all child comments
 

Is it just memory bandwidth? Or is it that AMD is not well supported by pytorch well enough for most products? Or some combination of those?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 1 year ago (1 children)

No consumer AMD hardware is on that list.

*No consumer Intel hardware is on that list.

The only widely available consumer hardware with AVX512 support is AMD's Zen4 (7000 series).

I think just about the only Apple computer that supports AVX512 is the 2019 mac pro.