this post was submitted on 24 Nov 2023
1 points (100.0% liked)

Hardware

33 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 11 months ago
MODERATORS
[email protected]
1
TOPS figures for AI Inferencing and how they compare. (alien.top)
submitted 10 months ago by [email protected] to c/[email protected]
1 comments fedilink hide all child comments
 

Several SoCs/APUs released recently come with an integrated AI engine.

Ryzen 7040 -> 10 TOPS XDNA AI Engine.

Snapdragon X Elite -> 45 TOPS Hexagon NPU

Apple M3 -> 18 TOPS Neural Engine

The soon to be released Intel Meteor Lake will also have an NPU.

How do these TOPS figures compare to GPUs such as the RTX 40 series models? They are notoriously being used for AI computation. But I haven't been able to find any TOPS figures for those dGPUs.

I want to know how these integrated NPUs stand against dGPUs in AI computation power.

top 1 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 10 months ago

Completely pointless to compare IMHO. A bit like comparing "core counts".