GeekRadar / The comparison desk
COMPARE.
Tested systems56 × NVIDIA GB200
Tested system
- Processor
- NVIDIA Grace CPU (Arm Neoverse-V2)
- Graphics
- NVIDIA GB200
- Accelerator count
- 56
- Nodes
- 14
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / deepseek-r1Offline · v6.1 · Tokens/s
56 × NVIDIA GB200
336,125* Tokens/s
- Accuracy target / result
- exact_match: 80.9936189608022 TOKENS_PER_SAMPLE: 3836.976071103008
- Weight precision
- fp4
- Division
- open
- System type
- datacenter
- Availability
- available
- Cores per processor
- 144
- Processors per node
- 2
- Nodes
- 14
- Total accelerators
- 56
- Software stack
- TensorRT 10.14, CUDA 13.1, TensorRT-LLM 1.3.0rc0
- Operating system
- Ubuntu 24.04.4 LTS, Linux 6.14.0-37-generic-64k
Processing & platform
- Processor
- NVIDIA Grace CPU (Arm Neoverse-V2)
- Graphics
- NVIDIA GB200
Connectivity & software
- Operating system
- Ubuntu 24.04.4 LTS, Linux 6.14.0-37-generic-64k
System configuration
- Reported host core count
- 144
- Processors per node
- 2
- Accelerator count
- 56
- Nodes
- 14
- Software stack
- TensorRT 10.14, CUDA 13.1, TensorRT-LLM 1.3.0rc0
- Submission division
- open
0 selected Compare 0
* Provisional data