this post was submitted on 14 Nov 2023
3 points (100.0% liked)
Hardware
33 readers
1 users here now
A place for quality hardware news, reviews, and intelligent discussion.
founded 11 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Fp8 performance per unit die apparently.
The 4090 has 660 fp8 tflops (which is insane when you think about it) and got the ban.
H100 is 1930 Fp8 tflops.
With sparsity both can do upto 2x that
The 4090 has more fp32 performance than the H100 though.
It's not specifically fp8, but TOPS*data size. Absolute limit is 4800, or 5.8/mm^(2). Above either is an outright ban. Above half of either needs a license.