GeekRadar / The comparison desk
COMPARE.
Tested systems
HPE

4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB

Tested system

Processor
AMD EPYC 9375F 32-Core Processor
Graphics
NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
Accelerator count
4
Nodes
1

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

MLPerf Inference / llama3.1-8b-edgeOffline · v6.1 · Tokens/s

4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB

9,557.69* Tokens/s

Accuracy target / result
ROUGE1: 38.7947 ROUGE2: 16.0822 ROUGEL: 24.5817 ROUGELSUM: 35.7134 GEN_LEN: 8173143
Weight precision
fp4
Division
open
System type
edge
Availability
available
Cores per processor
32
Processors per node
1
Nodes
1
Total accelerators
4
Software stack
TensorRT 10.15.1.29, CUDA 13.2
Operating system
Ubuntu 24.04.4
MLPerf Inference / llama3.1-8b-edgeSingleStream · v6.1 · Latency (ms)

4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB

1,203.79* Latency (ms)

Accuracy target / result
ROUGE1: 38.7883 ROUGE2: 16.056 ROUGEL: 24.5055 ROUGELSUM: 35.724 GEN_LEN: 8183134
Weight precision
fp4
Division
open
System type
edge
Availability
available
Cores per processor
32
Processors per node
1
Nodes
1
Total accelerators
4
Software stack
TensorRT 10.15.1.29, CUDA 13.2
Operating system
Ubuntu 24.04.4

Processing & platform

Processor
AMD EPYC 9375F 32-Core Processor
Graphics
NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB

Connectivity & software

Operating system
Ubuntu 24.04.4

System configuration

Reported host core count
32
Processors per node
1
Accelerator count
4
Nodes
1
Software stack
TensorRT 10.15.1.29, CUDA 13.2
Submission division
open

* Provisional data