GeekRadar / The comparison desk

COMPARE.

Accelerators

NVIDIA

NVIDIA H200 (SXM)

Accelerators

Processing & platform

Architecture: Hopper^*

Memory & storage

Video memory: 141 GB^*
Video memory type: HBM3e^*
Rated memory bandwidth: 4,800 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 26 fields

GPU architecture — NVIDIA H200 SXM — 141 GB HBM3e

Hopper^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989.5^* TFLOPS

Scope and conditions

Calculation: 1979 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989.5^* TFLOPS

Scope and conditions

Calculation: 1979 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

67^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H200 SXM — 141 GB HBM3e

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

34^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

67^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H200 SXM — 141 GB HBM3e

No^*

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Scope and conditions

Calculation: 3958 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

3,958^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TOPS

Scope and conditions

Calculation: 3958 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

3,958^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

494.5^* TFLOPS

Scope and conditions

Calculation: 989 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989^* TFLOPS

Physical configuration — NVIDIA H200 SXM — 141 GB HBM3e

SXM^*

GPU interconnect bandwidth (NVLink 4) bidirectional — NVIDIA H200 SXM — 141 GB HBM3e

900^* GB/s

GPU interconnect bandwidth per direction — NVIDIA H200 SXM — 141 GB HBM3e

450^* GB/s

Scope and conditions

Calculation: 900 / 2^*

PCIe interface declaration — NVIDIA H200 SXM — 141 GB HBM3e

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H200 SXM — 141 GB HBM3e

700^* W

Peak memory bandwidth per GPU — NVIDIA H200 SXM — 141 GB HBM3e

4,800^* GB/s

Memory capacity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

141^* GB

Memory reported in a documented driver sample — NVIDIA H200 SXM — 141 GB HBM3e

143,771^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA H200 SXM — 141 GB HBM3e

HBM3e^*

GPU model — NVIDIA H200 SXM — 141 GB HBM3e

NVIDIA H200 SXM^*

Specifications 2 · 16 fields

device name: NVIDIA H200 (SXM)^*
typical power w: 700^* W
on chip sram mb: 50^*
hbm memory gb: 141^* GB
memory bandwidth tb s: 4.8^*
headline metric: Same compute silicon as H100 (3958 TOPS INT8) but 141 GB HBM3e at 4.8 TB/s^*
source type: Vendor^*
vendor: NVIDIA^*
tops per watt calc: 5.654^*
compute paradigm: Electronic^*
device type: GPU^*
release year: 2024^*
maturity: Commercial^*
precision: INT8/FP8^*
throughput unit: TOPS^*
peak throughput: 3,958^*

* Provisional data