GeekRadar / The comparison desk
COMPARE.
Tested systems72 × AMD Instinct MI355X 288GB HBM3e
Tested system
- Processor
- AMD EPYC 9575F
- Graphics
- AMD Instinct MI355X 288GB HBM3e
- Accelerator count
- 72
- Nodes
- 9
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / gpt-oss-120bOffline · v6.1 · Tokens/s
72 × AMD Instinct MI355X 288GB HBM3e
1,039,900* Tokens/s
- Accuracy target / result
- exact_match: 83.230
- Weight precision
- mxfp4
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 64
- Processors per node
- 2
- Nodes
- 9
- Total accelerators
- 72
- Software stack
- vLLM 0.22.1.dev0, PyTorch 2.10.0, ROCm 7.2.2
- Operating system
- Ubuntu 22.04.2 LTS (kernel 5.15.0-70-generic)
MLPerf Inference / gpt-oss-120bServer · v6.1 · Tokens/s
72 × AMD Instinct MI355X 288GB HBM3e
964,468* Tokens/s
- Accuracy target / result
- exact_match: 83.446
- Weight precision
- mxfp4
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 64
- Processors per node
- 2
- Nodes
- 9
- Total accelerators
- 72
- Software stack
- vLLM 0.22.1.dev0, PyTorch 2.10.0, ROCm 7.2.2
- Operating system
- Ubuntu 22.04.2 LTS (kernel 5.15.0-70-generic)
Processing & platform
- Processor
- AMD EPYC 9575F
- Graphics
- AMD Instinct MI355X 288GB HBM3e
Connectivity & software
- Operating system
- Ubuntu 22.04.2 LTS (kernel 5.15.0-70-generic)
System configuration
- Reported host core count
- 64
- Processors per node
- 2
- Accelerator count
- 72
- Nodes
- 9
- Software stack
- vLLM 0.22.1.dev0, PyTorch 2.10.0, ROCm 7.2.2
- Submission division
- closed
0 selected Compare 0
* Provisional data