GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

NVIDIA H100 PCIe 96 GB

Graphics processor

Video memory: 96 GB^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 3,360 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper^*
Process node: 5 nm^*
GPU cores: 16,896^*
Graphics interface: PCIe 5.0 x16^*
Reported chip die area: 814 mm²^*
Transistors: 80,000 million^*
GPU L2 cache: 50 MB^*
Graphics processor: GH100^*
Texture mapping units: 528^*
Raster output units: 24^*
Streaming multiprocessors: 132^*
Tensor cores: 528^*
Chip foundry: TSMC^*
Card or module format: Dual-slot^*
Declared GPU TDP: 700 W^*
Suggested system PSU: 1,100 W^*
External power connectors: 8-pin EPS^*
OpenCL: 3.0^*
CUDA compute capability: 9.0^*

Memory & storage

Memory options: 96^*
Video memory: 96 GB^*
Video memory type: HBM3^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 3,360 GB/s^*

Power specifications

Thermal design power: 700 W^*

System configuration

Detailed specifications

Specifications 1 · 30 fields

proc transistors: 80,000 million^*
proc die size: 814^* mm²
cores: 16,896^*
tensor cores: 528^*
sm count: 132^*
base clock: 1,665^*
boost clock: 1,837^*
memory clock: 1,313^*
ram: 96^*
name: NVIDIA H100 PCIe 96 GB^*
ram type: HBM3^*
bus width: 5,120^*
bus interface: PCIe 5.0 x16^*
ram bandwidth: 3.36 TB/s^*
fp16 performance: 248.3^*
fp32 performance: 62.08^*
fp64 performance: 31.04^*
tdp: 700^* W
suggested psu: 1,100^* W
slot width: Dual-slot^*
power connectors: 8-pin EPS^*
api cuda: 9^*
is retail board: No^*
gpi value: 55.6^*
vendor: nvd^*
manufacturer: NVIDIA^*
arch name: Hopper^*
card release date: 2023-03-21^*
proc foundry: TSMC^*
proc process size: 5^* nm

Specifications 2 · 35 fields

CUDA compute capability

9.0^*

OpenCL

3.0^*

Architecture

Hopper^*

Graphics interface

PCIe 5.0 x16^*

Memory bus

5,120^* bit

Reported shader processors

16,896^*

Reported theoretical FP16 peak

248.3^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Reported theoretical FP32 peak

62.08^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Reported theoretical FP64 peak

31.04^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Declared L1 cache configuration

256 KB (per SM)^*

Declared GPU L2 cache

50 MB^*

Reported display outputs

No outputs^*

Theoretical pixel fill rate

44.09 GPixel/s^*

External power connectors

8-pin EPS^*

Reported chip die area

814 mm²^*

Chip foundry

TSMC^*

Process node declaration

5 nm^*

Transistors

80,000 million^*

Graphics processor

GH100^*

Reported video memory

96^* GB

Rated memory bandwidth

3.36 TB/s^*

Video memory type

HBM3^*

Raster output units

24^*

Reported shading units

16,896^*

Card or module format

Dual-slot^*

Streaming multiprocessors

132^*

Suggested system PSU

1100 W^*

2:4 tensor sparsity

Yes^*

Declared GPU TDP

700 W^*

Tensor cores

528^*

Theoretical texture fill rate

969.9 GTexel/s^*

Texture mapping units

528^*

GPU cores

16,896^*

Video memory

96^* GB

Video memory type

HBM3^*

* Provisional data