GeekRadar / The comparison desk
COMPARE.
Tested systems32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
Tested system
- Processor
- AMD EPYC 9534 (on MI300X node) and AMD EPYC 9965 (on MI355X node)
- Graphics
- AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
- Accelerator count
- 32
- Nodes
- 4
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / gpt-oss-120bOffline · v6.1 · Tokens/s
32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
285,454* Tokens/s
- Accuracy target / result
- exact_match: 84.250
- Weight precision
- fp8
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 64(AMD EPYC 9534) and 192(AMD EPYC 9965)
- Processors per node
- 2
- Nodes
- 4
- Total accelerators
- 32
- Software stack
- ROCm
- Operating system
- Ubuntu 22.04.5 LTS (jammy)
MLPerf Inference / gpt-oss-120bServer · v6.1 · Tokens/s
32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
253,501* Tokens/s
- Accuracy target / result
- exact_match: 83.574
- Weight precision
- fp8
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 64(AMD EPYC 9534) and 192(AMD EPYC 9965)
- Processors per node
- 2
- Nodes
- 4
- Total accelerators
- 32
- Software stack
- ROCm
- Operating system
- Ubuntu 22.04.5 LTS (jammy)
Processing & platform
- Processor
- AMD EPYC 9534 (on MI300X node) and AMD EPYC 9965 (on MI355X node)
- Graphics
- AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
Connectivity & software
- Operating system
- Ubuntu 22.04.5 LTS (jammy)
System configuration
- Processors per node
- 2
- Accelerator count
- 32
- Nodes
- 4
- Software stack
- ROCm
- Submission division
- closed
0 selected Compare 0
* Provisional data