GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

Graphics processor

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Blackwell^*
Video memory per GPU: 186 GB^*

Memory & storage

Video memory type: HBM3E^*

System configuration

Detailed specifications

Specifications · 27 fields

GPU architecture — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

Blackwell^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

2,500^* TFLOPS

Scope and conditions

Calculation: 5 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

5,000^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

2,500^* TFLOPS

Scope and conditions

Calculation: 5 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

5,000^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

80^* TFLOPS

Calculated theoretical peak: FP4 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

10,000^* TFLOPS

Scope and conditions

Calculation: 20 / 2^*

Theoretical peak: FP4 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

20,000^* TFLOPS

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

40^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

40^* TFLOPS

Calculated theoretical peak: FP6 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

5,000^* TFLOPS

Scope and conditions

Calculation: 10 / 2^*

Theoretical peak: FP6 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

10,000^* TFLOPS

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

5,000^* TFLOPS

Scope and conditions

Calculation: 10 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

10,000^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

5,000^* TOPS

Scope and conditions

Calculation: 10 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

10,000^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

1,250^* TFLOPS

Scope and conditions

Calculation: 2.5 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

2,500^* TFLOPS

Physical configuration — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

GB200 NVL4 board (4 Blackwell GPUs + 2 Grace CPUs, NVLink bridge)^*

GPU interconnect bandwidth (NVLink 5) bidirectional — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

1,800^* GB/s

GPU interconnect bandwidth per direction — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

900^* GB/s

PCIe interface declaration — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

PCIe Gen5: 128 GB/s^*

Maximum board power — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

1,200^* W

Peak memory bandwidth per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

8,000^* GB/s

Memory capacity per GPU — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

186^* GB

Memory technology — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

HBM3E^*

GPU model — NVIDIA GB200 NVL4 GPU component (186 GB per GPU)

NVIDIA Blackwell GPU (GB200 NVL4, individual GPU)^*

* Provisional data