GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

H200 SXM 141 GB

Graphics processor

Video memory: 141 GB^*
Memory bus: 6,144 bit^*
Rated memory bandwidth: 4,800 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper^*
Process node: 5 nm^*
GPU base clock: 1,500 MHz^*
GPU boost clock: 1,980 MHz^*

Memory & storage

Video memory: 141 GB^*
Video memory type: HBM3e^*
Memory bus: 6,144 bit^*
Rated memory bandwidth: 4,800 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 26 fields

GPU architecture — NVIDIA H200 SXM — 141 GB HBM3e

Hopper^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989.5^* TFLOPS

Scope and conditions

Calculation: 1979 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989.5^* TFLOPS

Scope and conditions

Calculation: 1979 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

67^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H200 SXM — 141 GB HBM3e

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

34^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

67^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H200 SXM — 141 GB HBM3e

No^*

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TFLOPS

Scope and conditions

Calculation: 3958 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

3,958^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

1,979^* TOPS

Scope and conditions

Calculation: 3958 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

3,958^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA H200 SXM — 141 GB HBM3e

494.5^* TFLOPS

Scope and conditions

Calculation: 989 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

989^* TFLOPS

Physical configuration — NVIDIA H200 SXM — 141 GB HBM3e

SXM^*

GPU interconnect bandwidth (NVLink 4) bidirectional — NVIDIA H200 SXM — 141 GB HBM3e

900^* GB/s

GPU interconnect bandwidth per direction — NVIDIA H200 SXM — 141 GB HBM3e

450^* GB/s

Scope and conditions

Calculation: 900 / 2^*

PCIe interface declaration — NVIDIA H200 SXM — 141 GB HBM3e

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H200 SXM — 141 GB HBM3e

700^* W

Peak memory bandwidth per GPU — NVIDIA H200 SXM — 141 GB HBM3e

4,800^* GB/s

Memory capacity per GPU — NVIDIA H200 SXM — 141 GB HBM3e

141^* GB

Memory reported in a documented driver sample — NVIDIA H200 SXM — 141 GB HBM3e

143,771^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA H200 SXM — 141 GB HBM3e

HBM3e^*

GPU model — NVIDIA H200 SXM — 141 GB HBM3e

NVIDIA H200 SXM^*

Specifications 2 · 49 fields

Brand: NVIDIA^*
Top BUS WIDTH: 6,144^* bit
Graphics Processor GPU Name: GH100^*
Graphics Processor Architecture: Hopper^*
Render Config SM Count: 132^*
Graphics Features CUDA: 9^*
Render Config Tensor Cores: 528^*
Graphics Processor Process Size: 5^* nm
Graphics Processor Transistors: 80,000 million^*
Graphics Processor Die Size: 814^* mm²
Graphics Card Release Date: Nov 18th, 2024^*
Graphics Card Generation: Server Hopper (Hxx)^*
Graphics Card Successor: Server Blackwell^*
Graphics Card Production: Active^*
Name: H200 SXM 141 GB^*
Graphics Card Bus Interface: PCIe 5.0 x16^*
Clock Speeds Memory Clock: 1593 MHz 6.4 Gbps effective^*
Memory Memory Size: 141^* GB
Memory Memory Type: HBM3e^*
Memory Memory Bus: 6,144^* bit
Memory Bandwidth: 4.89 TB/s^*
Render Config TMUs: 528^*
Top GRAPHICS PROCESSOR: GH100^*
Render Config ROPs: 24^*
Theoretical Performance Pixel Rate: 47.52 GPixel/s
Theoretical Performance Texture Rate: 1,045.4 GTexel/s
Board Design Slot Width: SXM Module^*
Board Design TDP: 700^* W
Board Design Suggested PSU: 1,100^* W
Board Design Outputs: No outputs^*
Graphics Features OpenCL: 3^*
source file: nvidia2024.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Server Ada^*
Board Design Power Connectors: 8-pin EPS^*
Graphics Processor Density: 98.3M / mm²^*
Top TMUS: 528^*
Top ROPS: 24^*
Clock Speeds Base Clock: 1,500^* MHz
Clock Speeds Boost Clock: 1,980^* MHz
Top CORES: 16,896^*
Render Config Shading Units: 16,896^*
Render Config L2 Cache: 50^* MB
Top MEMORY SIZE: 141^* GB
Theoretical Performance FP32 (float): 66.91^* TFLOPS
Theoretical Performance FP64 (double): 33.45 TFLOPS (1:2)
Render Config L1 Cache: 256 KB (per SM)^*
Theoretical Performance FP16 (half): 267.6 TFLOPS (4:1)
Top MEMORY TYPE: HBM3e^*

* Provisional data