this post was submitted on 08 Nov 2023
1 points (100.0% liked)

Hardware

47 readers
1 users here now

A place for quality hardware news, reviews, and intelligent discussion.

founded 1 year ago
MODERATORS
[email protected]
1
Nvidia, Intel claim new LLM training speed records in new MLPerf 3.1 benchmark (venturebeat.com)
submitted 1 year ago by [email protected] to c/[email protected]
6 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 0 points 1 year ago (2 children)

Among many new records and milestones, one in generative AI stands out: NVIDIA Eos — an AI supercomputer powered by a whopping 10,752 NVIDIA H100 Tensor Core GPUs and NVIDIA Quantum-2 InfiniBand networking — completed a training benchmark based on a GPT-3 model with 175 billion parameters trained on one billion tokens in just 3.9 minutes.

[–] [email protected] 1 points 1 year ago

Wow I wonder how long that would have taken in Turing/Volta era hardware.

[–] [email protected] 1 points 1 year ago

What does it mean to train on such-and-such number of tokens?