GeekRadar / The comparison desk
COMPARE.
Tested systems16 × NVIDIA GB200
Tested system
- Processor
- NVIDIA Grace CPU (Arm Neoverse-V2)
- Graphics
- NVIDIA GB200
- Accelerator count
- 16
- Nodes
- 4
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / deepseek-r1Offline · v6.1 · Tokens/s
16 × NVIDIA GB200
126,223* Tokens/s
- Accuracy target / result
- exact_match: 81.38103919781221 TOKENS_PER_SAMPLE: 3823.224020054695
- Weight precision
- fp4
- Division
- open
- System type
- datacenter
- Availability
- available
- Cores per processor
- 144
- Processors per node
- 2
- Nodes
- 4
- Total accelerators
- 16
- Software stack
- TensorRT 10.14, CUDA 13.1, TensorRT-LLM 1.3.0rc0
- Operating system
- Ubuntu 24.04.4 LTS, Linux 6.14.0-37-generic-64k
Processing & platform
- Processor
- NVIDIA Grace CPU (Arm Neoverse-V2)
- Graphics
- NVIDIA GB200
Connectivity & software
- Operating system
- Ubuntu 24.04.4 LTS, Linux 6.14.0-37-generic-64k
System configuration
- Reported host core count
- 144
- Processors per node
- 2
- Accelerator count
- 16
- Nodes
- 4
- Software stack
- TensorRT 10.14, CUDA 13.1, TensorRT-LLM 1.3.0rc0
- Submission division
- open
0 selected Compare 0
* Provisional data