this post was submitted on 28 Nov 2023
1 points (100.0% liked)
AMD
26 readers
1 users here now
For all things AMD; come talk about Ryzen, Radeon, Threadripper, EPYC, rumors, reviews, news and more.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Would've been good budget option for hobby AI if it wasn't about 200x slower than Intel A770 for SD/LLMs.
I agree. I did deep fakes years ago with my 580, and having 16GB of VRAM would've been great for dealing with larger models and whatnot, but it's past its prime at this point. Most budget cards today would be faster than it in compute, so that would be the reasonable option compared to the novelty of a 16GB 580.
Also, is the A770 really 200x faster in SD/LLMs or is that an exaggeration? I'm asking out of curiosity. I did some SD with DirectML and it was certainly slow, around 2 minutes for a set of images.
Probably a bit of an exaggeration but not too much. Intel released OpenVINO, making the A770 about 7x faster than the RX 6700.
That sounds about right. Nvidia and Intel seem to have better computer API support than AMD, so it doesn't surprise me that the A770 performs much better with OpenVINO compared to the 6700. Alchemist is generally powerful in computer anyways, so that helps too.