GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

NVIDIA H100 GPU accelerator (SXM card)

Graphics processor Released Mar 22, 2022

Video memory: 80 GB^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 3,350 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper

GPU configurations

Reference configuration
Rated power
700 W
Power specification
TDP

Memory & storage

Video memory: 80 GB^*
Video memory type: HBM3^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 3,350 GB/s^*

Power specifications

Thermal design power: 700 W

System configuration

Detailed specifications

Specifications 1 · 22 fields

GPU architecture — NVIDIA H100 SXM — 80 GB HBM3

Hopper^*

Theoretical peak: BF16 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

989.4^* TFLOPS

Scope and conditions

Accumulation: FP32^*

Theoretical peak: FP16 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

989.4^* TFLOPS

Scope and conditions

Accumulation: FP32^*

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

66.9^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H100 SXM — 80 GB HBM3

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

33.5^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

66.9^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H100 SXM — 80 GB HBM3

No^*

Theoretical peak: FP8 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

1,978.9^* TFLOPS

Scope and conditions

Accumulation: FP32^*

Theoretical peak: INT8 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

1,978.9^* TOPS

Theoretical peak: TF32 tensor dense per GPU — NVIDIA H100 SXM — 80 GB HBM3

494.7^* TFLOPS

Physical configuration — NVIDIA H100 SXM — 80 GB HBM3

SXM5^*

GPU interconnect bandwidth (NVLink 4) bidirectional — NVIDIA H100 SXM — 80 GB HBM3

900^* GB/s

GPU interconnect bandwidth per direction — NVIDIA H100 SXM — 80 GB HBM3

450^* GB/s

Scope and conditions

Calculation: 900 / 2^*

PCIe interface declaration — NVIDIA H100 SXM — 80 GB HBM3

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H100 SXM — 80 GB HBM3

700^* W

Peak memory bandwidth per GPU — NVIDIA H100 SXM — 80 GB HBM3

3,350^* GB/s

Memory interface width per GPU — NVIDIA H100 SXM — 80 GB HBM3

5,120^* bit

Memory capacity per GPU — NVIDIA H100 SXM — 80 GB HBM3

80^* GB

Memory reported in a documented driver sample — NVIDIA H100 SXM — 80 GB HBM3

81,559^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA H100 SXM — 80 GB HBM3

HBM3^*

GPU model — NVIDIA H100 SXM — 80 GB HBM3

NVIDIA H100 SXM^*

Specifications 2 · 7 fields

Form factor declaration

SXM^*

Graphics model

H100 SXM^*

Full graphics designation

NVIDIA H100 SXM^*

Manufacturer

NVIDIA^*

Memory capacity declaration

80^* GB

Scope and conditions

native_context

Capacity unit base: Not independently established^*

Memory technology

HBM3^*

Thermal design power declaration

700^* W

Specifications 3 · 3 fields

model

H100 GPU accelerator (SXM card)^*

Scope and conditions

source_native_row_context

model: H100 GPU accelerator (SXM card)^*

tdp watts

700.0^* W

Scope and conditions

source_native_row_context

model: H100 GPU accelerator (SXM card)^*

manufacturer

Nvidia^*

Scope and conditions

source_native_row_context

model: H100 GPU accelerator (SXM card)^*

Specifications 4 · 5 fields

Nominal GPU Memory

80^* GB · HBM3^*

Scope and conditions

native_context

Memory scope: Nominal per-GPU memory; not the total CPU + GPU module memory or runtime-available capacity^*
memory role: nominal_release_inventory^*
not dedicated VRAM for shared memory systems: Yes^*
not runtime available or HGX usable capacity: Yes^*

GPU Aggregate Bandwidth per 8-GPU Node

26.8^* TB/s

Scope and conditions

native_context

capacity unit base: not_established^*
configuration: HGX 8-GPU baseboard^*
memory role: production_HGX_configuration^*
resource scope: eight_GPU_aggregate^*

Memory per 8-GPU Node

640^* GB · HBM3^*

Scope and conditions

native_context

capacity unit base: not_established^*
configuration: HGX 8-GPU baseboard^*
memory role: production_HGX_configuration^*
resource scope: eight_GPU_aggregate^*

GPU Bandwidth

3.35^* TB/s

Scope and conditions

native_context

capacity unit base: not_established^*
configuration: HGX 8-GPU baseboard^*
memory role: production_HGX_configuration^*
resource scope: per_GPU^*

Memory per GPU

80^* GB · HBM3^*

Scope and conditions

native_context

capacity unit base: not_established^*
configuration: HGX 8-GPU baseboard^*
memory role: production_HGX_configuration^*
resource scope: per_GPU^*

* Provisional data