GeekRadar / The comparison desk
COMPARE.
Tested systems4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
Tested system
- Processor
- AMD EPYC 9375F 32-Core Processor
- Graphics
- NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
- Accelerator count
- 4
- Nodes
- 1
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / llama3.1-8b-edgeOffline · v6.1 · Tokens/s
4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
9,557.69* Tokens/s
- Accuracy target / result
- ROUGE1: 38.7947 ROUGE2: 16.0822 ROUGEL: 24.5817 ROUGELSUM: 35.7134 GEN_LEN: 8173143
- Weight precision
- fp4
- Division
- open
- System type
- edge
- Availability
- available
- Cores per processor
- 32
- Processors per node
- 1
- Nodes
- 1
- Total accelerators
- 4
- Software stack
- TensorRT 10.15.1.29, CUDA 13.2
- Operating system
- Ubuntu 24.04.4
MLPerf Inference / llama3.1-8b-edgeSingleStream · v6.1 · Latency (ms)
4 × NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
1,203.79* Latency (ms)
- Accuracy target / result
- ROUGE1: 38.7883 ROUGE2: 16.056 ROUGEL: 24.5055 ROUGELSUM: 35.724 GEN_LEN: 8183134
- Weight precision
- fp4
- Division
- open
- System type
- edge
- Availability
- available
- Cores per processor
- 32
- Processors per node
- 1
- Nodes
- 1
- Total accelerators
- 4
- Software stack
- TensorRT 10.15.1.29, CUDA 13.2
- Operating system
- Ubuntu 24.04.4
Processing & platform
- Processor
- AMD EPYC 9375F 32-Core Processor
- Graphics
- NVIDIA RTX PRO 4500 Blackwell-PCIe-32GB
Connectivity & software
- Operating system
- Ubuntu 24.04.4
System configuration
- Reported host core count
- 32
- Processors per node
- 1
- Accelerator count
- 4
- Nodes
- 1
- Software stack
- TensorRT 10.15.1.29, CUDA 13.2
- Submission division
- open
0 selected Compare 0
* Provisional data