GeekRadar / The comparison desk
COMPARE.
Tested systems
Dell_MangoBoost

32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)

Tested system

Processor
AMD EPYC 9534 (on MI300X node) and AMD EPYC 9965 (on MI355X node)
Graphics
AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)
Accelerator count
32
Nodes
4

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

MLPerf Inference / gpt-oss-120bOffline · v6.1 · Tokens/s

32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)

285,454* Tokens/s

Accuracy target / result
exact_match: 84.250
Weight precision
fp8
Division
closed
System type
datacenter
Availability
available
Cores per processor
64(AMD EPYC 9534) and 192(AMD EPYC 9965)
Processors per node
2
Nodes
4
Total accelerators
32
Software stack
ROCm
Operating system
Ubuntu 22.04.5 LTS (jammy)
MLPerf Inference / gpt-oss-120bServer · v6.1 · Tokens/s

32 × AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)

253,501* Tokens/s

Accuracy target / result
exact_match: 83.574
Weight precision
fp8
Division
closed
System type
datacenter
Availability
available
Cores per processor
64(AMD EPYC 9534) and 192(AMD EPYC 9965)
Processors per node
2
Nodes
4
Total accelerators
32
Software stack
ROCm
Operating system
Ubuntu 22.04.5 LTS (jammy)

Processing & platform

Processor
AMD EPYC 9534 (on MI300X node) and AMD EPYC 9965 (on MI355X node)
Graphics
AMD Instinct MI300X 192GB HBM3 (x2x8) and AMD Instinct MI355X 288GB HBM3e (x2x8)

Connectivity & software

Operating system
Ubuntu 22.04.5 LTS (jammy)

System configuration

Processors per node
2
Accelerator count
32
Nodes
4
Software stack
ROCm
Submission division
closed

* Provisional data