GeekRadar / The comparison desk

COMPARE.

Accelerators

NVIDIA

NVIDIA B200

Accelerators

Processing & platform

Architecture: Blackwell^*

Memory & storage

Video memory: 180 GB^*
Video memory type: HBM3E^*
Rated memory bandwidth: 7,700 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 28 fields

GPU architecture — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

Blackwell^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

2,250^* TFLOPS

Scope and conditions

Calculation: 4.5 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

4,500^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

2,250^* TFLOPS

Scope and conditions

Calculation: 4.5 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

4,500^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

75^* TFLOPS

Calculated theoretical peak: FP4 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

9,000^* TFLOPS

Scope and conditions

Calculation: 18 / 2^*

Theoretical peak: FP4 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

18,000^* TFLOPS

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

37^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

37^* TFLOPS

Calculated theoretical peak: FP6 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

4,500^* TFLOPS

Scope and conditions

Calculation: 9 / 2^*

Theoretical peak: FP6 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

9,000^* TFLOPS

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

4,500^* TFLOPS

Scope and conditions

Calculation: 9 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

9,000^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

4,500^* TOPS

Scope and conditions

Calculation: 9 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

9,000^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

1,100^* TFLOPS

Scope and conditions

Calculation: 2.2 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

2,200^* TFLOPS

Physical configuration — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

SXM (HGX 8-GPU baseboard)^*

GPU interconnect bandwidth (NVLink 5) bidirectional — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

1,800^* GB/s

GPU interconnect bandwidth per direction — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

900^* GB/s

PCIe interface declaration — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

PCIe Gen5: 128 GB/s^*

Maximum board power — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

1,000^* W

Peak memory bandwidth per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

7,700^* GB/s

Memory capacity per GPU — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

180^* GB

Memory reported in a documented driver sample — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

183,359^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

HBM3E^*

GPU model — NVIDIA Blackwell GPU (HGX B200 / DGX B200) — 180 GB HBM3E

NVIDIA Blackwell GPU (HGX B200 / DGX B200)^*

Specifications 2 · 15 fields

device name: NVIDIA B200^*
typical power w: 1,000^* W
hbm memory gb: 180^* GB
memory bandwidth tb s: 7.7^*
headline metric: 10 POPS (10,000 TOPS) INT8/FP8 dense; adds FP4 up to 18 PFLOPS sparse; 180 GB HBM3e^*
source type: Vendor^*
vendor: NVIDIA^*
tops per watt calc: 10^*
compute paradigm: Electronic^*
device type: GPU^*
release year: 2024^*
maturity: Commercial^*
precision: INT8/FP8^*
throughput unit: TOPS^*
peak throughput: 10,000^*

* Provisional data