GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

H200 NVL

Graphics processor

Video memory: 141 GB^*
Memory bus: 6,144 bit^*
Rated memory bandwidth: 4,800 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper^*
Process node: 5 nm^*
GPU base clock: 1,365 MHz^*
GPU boost clock: 1,785 MHz^*

Memory & storage

Video memory: 141 GB^*
Video memory type: HBM3e^*
Memory bus: 6,144 bit^*
Rated memory bandwidth: 4,800 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 24 fields

GPU architecture — NVIDIA H200 NVL — 141 GB HBM3e

Hopper^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

1,671^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

1,671^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

60^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H200 NVL — 141 GB HBM3e

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

30^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

60^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H200 NVL — 141 GB HBM3e

No^*

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

1,670.5^* TFLOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

3,341^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

1,670.5^* TOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

3,341^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA H200 NVL — 141 GB HBM3e

417.5^* TFLOPS

Scope and conditions

Calculation: 835 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

835^* TFLOPS

Physical configuration — NVIDIA H200 NVL — 141 GB HBM3e

NVL (PCIe dual-slot, NVLink bridge)^*

GPU interconnect bandwidth (NVLink bridge (2- or 4-way)) — NVIDIA H200 NVL — 141 GB HBM3e

900^* GB/s

PCIe interface declaration — NVIDIA H200 NVL — 141 GB HBM3e

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H200 NVL — 141 GB HBM3e

600^* W

Peak memory bandwidth per GPU — NVIDIA H200 NVL — 141 GB HBM3e

4,800^* GB/s

Memory capacity per GPU — NVIDIA H200 NVL — 141 GB HBM3e

141^* GB

Memory technology — NVIDIA H200 NVL — 141 GB HBM3e

HBM3e^*

GPU model — NVIDIA H200 NVL — 141 GB HBM3e

NVIDIA H200 NVL^*

Specifications 2 · 51 fields

Brand: NVIDIA^*
Top BUS WIDTH: 6,144^* bit
Graphics Processor GPU Name: GH100^*
Graphics Processor Architecture: Hopper^*
Render Config SM Count: 132^*
Graphics Features CUDA: 9^*
Render Config Tensor Cores: 528^*
Graphics Processor Process Size: 5^* nm
Graphics Processor Transistors: 80,000 million^*
Graphics Processor Die Size: 814^* mm²
Graphics Card Release Date: Nov 18th, 2024^*
Graphics Card Generation: Server Hopper (Hxx)^*
Graphics Card Successor: Server Blackwell^*
Graphics Card Production: Active^*
Name: H200 NVL^*
Graphics Card Bus Interface: PCIe 5.0 x16^*
Clock Speeds Memory Clock: 1593 MHz 6.4 Gbps effective^*
Memory Memory Size: 141^* GB
Memory Memory Type: HBM3e^*
Memory Memory Bus: 6,144^* bit
Memory Bandwidth: 4.89 TB/s^*
Render Config TMUs: 528^*
Top GRAPHICS PROCESSOR: GH100^*
Render Config ROPs: 24^*
Theoretical Performance Pixel Rate: 42.84 GPixel/s
Theoretical Performance Texture Rate: 942.5 GTexel/s
Board Design Slot Width: Dual-slot^*
Board Design TDP: 600^* W
Board Design Suggested PSU: 1,000^* W
Board Design Outputs: No outputs^*
Graphics Features OpenCL: 3^*
source file: nvidia2024.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Server Ada^*
Board Design Length: 267 mm 10.5 inches^*
Board Design Power Connectors: 8-pin EPS^*
Graphics Processor Density: 98.3M / mm²^*
Board Design Height: 111 mm 4.4 inches^*
Top TMUS: 528^*
Top ROPS: 24^*
Clock Speeds Base Clock: 1,365^* MHz
Clock Speeds Boost Clock: 1,785^* MHz
Top CORES: 16,896^*
Render Config Shading Units: 16,896^*
Render Config L2 Cache: 50^* MB
Top MEMORY SIZE: 141^* GB
Theoretical Performance FP32 (float): 60.32^* TFLOPS
Theoretical Performance FP64 (double): 30.16 TFLOPS (1:2)
Render Config L1 Cache: 256 KB (per SM)^*
Theoretical Performance FP16 (half): 241.3 TFLOPS (4:1)
Top MEMORY TYPE: HBM3e^*

* Provisional data