GeekRadar / The comparison desk
COMPARE.
Tested systems
Cisco

4 × NVIDIA RTX PRO 4500 Blackwell

Tested system

Processor
Intel(R) Xeon(R) 6747P
Graphics
NVIDIA RTX PRO 4500 Blackwell
Accelerator count
4
Nodes
1

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

MLPerf Inference / llama3.1-8bOffline · v6.1 · Tokens/s

4 × NVIDIA RTX PRO 4500 Blackwell

9,518.66* Tokens/s

Accuracy target / result
ROUGE1: 38.7664 ROUGE2: 16.0107 ROUGEL: 24.5281 ROUGELSUM: 35.6917 GEN_LEN: 8178365
Weight precision
fp4
Division
closed
System type
datacenter
Availability
available
Cores per processor
48
Processors per node
2
Nodes
1
Total accelerators
4
Software stack
TensorRT 10.14, CUDA 13.1
Operating system
Ubuntu 24.04
MLPerf Inference / llama3.1-8bServer · v6.1 · Tokens/s

4 × NVIDIA RTX PRO 4500 Blackwell

9,277.73* Tokens/s

Accuracy target / result
ROUGE1: 38.7836 ROUGE2: 16.0298 ROUGEL: 24.5367 ROUGELSUM: 35.7048 GEN_LEN: 8178628
Weight precision
fp4
Division
closed
System type
datacenter
Availability
available
Cores per processor
48
Processors per node
2
Nodes
1
Total accelerators
4
Software stack
TensorRT 10.14, CUDA 13.1
Operating system
Ubuntu 24.04
MLPerf Inference / whisperOffline · v6.1 · Samples/s

4 × NVIDIA RTX PRO 4500 Blackwell

3,877.67* Samples/s

Accuracy target / result
ACCURACY: 97.86822996469256
Weight precision
fp16
Division
closed
System type
datacenter
Availability
available
Cores per processor
48
Processors per node
2
Nodes
1
Total accelerators
4
Software stack
TensorRT 10.14, CUDA 13.1
Operating system
Ubuntu 24.04

Processing & platform

Processor
Intel(R) Xeon(R) 6747P
Graphics
NVIDIA RTX PRO 4500 Blackwell

Connectivity & software

Operating system
Ubuntu 24.04

System configuration

Reported host core count
48
Processors per node
2
Accelerator count
4
Nodes
1
Software stack
TensorRT 10.14, CUDA 13.1
Submission division
closed

* Provisional data