this post was submitted on 17 Nov 2023
0 points (50.0% liked)

Hardware

33 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 11 months ago
MODERATORS
[email protected]
0
An EPYC Miss? Microsoft Azure Instances Pair AMD's MI300X With Intel's Sapphire Rapids (www.tomshardware.com)
submitted 10 months ago by [email protected] to c/[email protected]
8 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 10 months ago

Microsoft doesn't seem to advertise the acceleration capabilities of SPR in these instances. I've heard good things about AMX for inference. Here's VMWare accelerating a 7b model, but in the scope of large scale training and inference, I don't think there's a role to be played by SPR's accelerators.

I think it's just a difference of platform validation time.

We're beginning to see Genoa AI platforms roll out now from several CSPs.