8 × NVIDIA B300-SXM-270GB

Tested system

Processor: Intel(R) Xeon(R) 6776P
Graphics: NVIDIA B300-SXM-270GB
Accelerator count: 8
Nodes: 1

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

MLPerf Inference / deepseek-r1Offline · v6.1 · Tokens/s

8 × NVIDIA B300-SXM-270GB

36,639.60^* Tokens/s

Accuracy target / result: exact_match: 81.22151321786691 TOKENS_PER_SAMPLE: 3770.8865086599817
Weight precision: fp4
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / deepseek-r1Server · v6.1 · Tokens/s

8 × NVIDIA B300-SXM-270GB

33,415.20^* Tokens/s

Accuracy target / result: exact_match: 81.83682771194167 TOKENS_PER_SAMPLE: 3750.4530537830447
Weight precision: fp4
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / llama3.1-8bOffline · v6.1 · Tokens/s

8 × NVIDIA B300-SXM-270GB

161,767^* Tokens/s

Accuracy target / result: ROUGE1: 38.5395 ROUGE2: 15.7648 ROUGEL: 24.3262 ROUGELSUM: 35.5597 GEN_LEN: 8190944
Weight precision: fp4
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / llama3.1-8bServer · v6.1 · Tokens/s

8 × NVIDIA B300-SXM-270GB

156,867^* Tokens/s

Accuracy target / result: ROUGE1: 38.5355 ROUGE2: 15.7593 ROUGEL: 24.3212 ROUGELSUM: 35.5549 GEN_LEN: 8191008
Weight precision: fp4
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / wan-2.2-t2v-a14bOffline · v6.1 · Samples/s

8 × NVIDIA B300-SXM-270GB

0.08^* Samples/s

Accuracy target / result: vbench_score: 70.1187
Weight precision: fp32
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / wan-2.2-t2v-a14bSingleStream · v6.1 · Latency (s)

8 × NVIDIA B300-SXM-270GB

21.28^* Latency (s)

Accuracy target / result: vbench_score: 70.3113
Weight precision: fp32
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

MLPerf Inference / whisperOffline · v6.1 · Samples/s

8 × NVIDIA B300-SXM-270GB

53,267.20^* Samples/s

Accuracy target / result: ACCURACY: 97.85680976807484
Weight precision: fp16
Division: closed
System type: datacenter
Availability: available
Cores per processor: 48
Processors per node: 2
Nodes: 1
Total accelerators: 8
Software stack: TensorRT 10.14, CUDA 13.1
Operating system: Ubuntu 24.04

Processing & platform

Processor: Intel(R) Xeon(R) 6776P
Graphics: NVIDIA B300-SXM-270GB

Connectivity & software

Operating system: Ubuntu 24.04

System configuration

Reported host core count: 48
Processors per node: 2
Accelerator count: 8
Nodes: 1
Software stack: TensorRT 10.14, CUDA 13.1
Submission division: closed

* Provisional data