Vushivushi

joined 11 months ago
[–] [email protected] 1 points 10 months ago

Microsoft doesn't seem to advertise the acceleration capabilities of SPR in these instances. I've heard good things about AMX for inference. Here's VMWare accelerating a 7b model, but in the scope of large scale training and inference, I don't think there's a role to be played by SPR's accelerators.

I think it's just a difference of platform validation time.

We're beginning to see Genoa AI platforms roll out now from several CSPs.

[–] [email protected] 1 points 10 months ago (1 children)

Nope. GeForce Now only supports 4K120 on Windows and the latest Steam Deck Windows driver does not support the hardware decoding necessary. Windows-based handhelds will work for you.