GeekRadar / The comparison desk
COMPARE.
GPU
NVIDIA

H100 PCIe

Graphics processor

Video memory
80 GB*
Memory bus
5,120 bit*
Rated memory bandwidth
2,000 GB/s*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture
Hopper*
GPU base clock
1,125 MHz*

Memory & storage

Video memory
80 GB*
Video memory type
HBM2e*
Memory bus
5,120 bit*
Rated memory bandwidth
2,000 GB/s*

System configuration

Detailed specifications

Specifications 1 · 21 fields
GPU architecture — NVIDIA H100 PCIe — 80 GB HBM2e
Hopper*
Theoretical peak: BF16 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
756* TFLOPS
Scope and conditions
Accumulation
FP32*
Theoretical peak: FP16 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
756* TFLOPS
Scope and conditions
Accumulation
FP32*
Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
51.2* TFLOPS
Native hardware support: FP4 tensor — NVIDIA H100 PCIe — 80 GB HBM2e
No*
Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
25.6* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
51.2* TFLOPS
Native hardware support: FP6 tensor — NVIDIA H100 PCIe — 80 GB HBM2e
No*
Theoretical peak: FP8 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
1,513* TFLOPS
Scope and conditions
Accumulation
FP32*
Theoretical peak: INT8 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
1,513* TOPS
Theoretical peak: TF32 tensor dense per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
378* TFLOPS
Physical configuration — NVIDIA H100 PCIe — 80 GB HBM2e
PCIe (FHFL dual-slot)*
GPU interconnect bandwidth (NVLink 4 (three NVLink bridges, two cards)) — NVIDIA H100 PCIe — 80 GB HBM2e
600* GB/s
PCIe interface declaration — NVIDIA H100 PCIe — 80 GB HBM2e
PCI Express Gen5 x16*
Maximum board power — NVIDIA H100 PCIe — 80 GB HBM2e
350* W
Peak memory bandwidth per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
2,000* GB/s
Memory interface width per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
5,120* bit
Memory capacity per GPU — NVIDIA H100 PCIe — 80 GB HBM2e
80* GB
Memory reported in a documented driver sample — NVIDIA H100 PCIe — 80 GB HBM2e
81,559* MiB
Scope and conditions
Configuration
Documented driver sample; not nominal VRAM capacity.*
Memory technology — NVIDIA H100 PCIe — 80 GB HBM2e
HBM2e*
GPU model — NVIDIA H100 PCIe — 80 GB HBM2e
NVIDIA H100 PCIe*
Specifications 2 · 8 fields
Product Name
H100 PCIe*
GPU Chip
GH100*
Released
Mar 22nd, 2022*
Bus
PCIe 5.0 x16*
Memory
80 GB, HBM2e, 5120 bit*
GPU clock
1,125* MHz
Memory clock
1,000* MHz
Shaders TMUs ROPs
7296 / 456 / 24*
Specifications 3 · 14 fields
manufacturer
NVIDIA*
rop
24*
igp
No*
bus
PCIe 5.0 x16*
memType
HBM2e*
gpuChip
GH100*
productName
H100 PCIe*
releaseYear
2,022*
memSize
80*
memBusWidth
5,120*
gpuClock
1,065*
memClock
1,000*
unifiedShader
14,592*
tmu
456*

* Provisional data