GeekRadar / The comparison desk
COMPARE.
Tested systems4 × NVIDIA RTX PRO 4500 Blackwell
Tested system
- Processor
- Intel(R) Xeon(R) 6747P
- Graphics
- NVIDIA RTX PRO 4500 Blackwell
- Accelerator count
- 4
- Nodes
- 1
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
MLPerf Inference / llama3.1-8bOffline · v6.1 · Tokens/s
4 × NVIDIA RTX PRO 4500 Blackwell
9,518.66* Tokens/s
- Accuracy target / result
- ROUGE1: 38.7664 ROUGE2: 16.0107 ROUGEL: 24.5281 ROUGELSUM: 35.6917 GEN_LEN: 8178365
- Weight precision
- fp4
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 48
- Processors per node
- 2
- Nodes
- 1
- Total accelerators
- 4
- Software stack
- TensorRT 10.14, CUDA 13.1
- Operating system
- Ubuntu 24.04
MLPerf Inference / llama3.1-8bServer · v6.1 · Tokens/s
4 × NVIDIA RTX PRO 4500 Blackwell
9,277.73* Tokens/s
- Accuracy target / result
- ROUGE1: 38.7836 ROUGE2: 16.0298 ROUGEL: 24.5367 ROUGELSUM: 35.7048 GEN_LEN: 8178628
- Weight precision
- fp4
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 48
- Processors per node
- 2
- Nodes
- 1
- Total accelerators
- 4
- Software stack
- TensorRT 10.14, CUDA 13.1
- Operating system
- Ubuntu 24.04
MLPerf Inference / whisperOffline · v6.1 · Samples/s
4 × NVIDIA RTX PRO 4500 Blackwell
3,877.67* Samples/s
- Accuracy target / result
- ACCURACY: 97.86822996469256
- Weight precision
- fp16
- Division
- closed
- System type
- datacenter
- Availability
- available
- Cores per processor
- 48
- Processors per node
- 2
- Nodes
- 1
- Total accelerators
- 4
- Software stack
- TensorRT 10.14, CUDA 13.1
- Operating system
- Ubuntu 24.04
Processing & platform
- Processor
- Intel(R) Xeon(R) 6747P
- Graphics
- NVIDIA RTX PRO 4500 Blackwell
Connectivity & software
- Operating system
- Ubuntu 24.04
System configuration
- Reported host core count
- 48
- Processors per node
- 2
- Accelerator count
- 4
- Nodes
- 1
- Software stack
- TensorRT 10.14, CUDA 13.1
- Submission division
- closed
0 selected Compare 0
* Provisional data