GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

H100 NVL 94 GB

Graphics processor

Video memory: 94 GB^*
Memory bus: 6,016 bit^*
Rated memory bandwidth: 3,938 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper^*
Process node: 5 nm^*
GPU base clock: 1,080 MHz^*
GPU boost clock: 1,785 MHz^*

Memory & storage

Video memory: 94 GB^*
Video memory type: HBM3^*
Memory bus: 6,016 bit^*
Rated memory bandwidth: 3,938 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 27 fields

GPU architecture — NVIDIA H100 NVL — 94 GB HBM3

Hopper^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,671^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,671^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

60^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H100 NVL — 94 GB HBM3

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

30^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

60^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H100 NVL — 94 GB HBM3

No^*

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,670.5^* TFLOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,341^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,670.5^* TOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,341^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

417.5^* TFLOPS

Scope and conditions

Calculation: 835 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

835^* TFLOPS

Physical configuration — NVIDIA H100 NVL — 94 GB HBM3

NVL (PCIe dual-slot, NVLink bridge)^*

GPU interconnect bandwidth (NVLink 4 (three NVLink bridges, two cards)) bidirectional — NVIDIA H100 NVL — 94 GB HBM3

600^* GB/s

GPU interconnect bandwidth per direction — NVIDIA H100 NVL — 94 GB HBM3

300^* GB/s

Scope and conditions

Calculation: 600 / 2^*

PCIe interface declaration — NVIDIA H100 NVL — 94 GB HBM3

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H100 NVL — 94 GB HBM3

400^* W

Peak memory bandwidth per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,938^* GB/s

Memory interface width per GPU — NVIDIA H100 NVL — 94 GB HBM3

6,016^* bit

Memory capacity per GPU — NVIDIA H100 NVL — 94 GB HBM3

94^* GB

Memory reported in a documented driver sample — NVIDIA H100 NVL — 94 GB HBM3

95,830^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA H100 NVL — 94 GB HBM3

HBM3^*

GPU model — NVIDIA H100 NVL — 94 GB HBM3

NVIDIA H100 NVL^*

Specifications 2 · 52 fields

Brand: NVIDIA^*
Top BUS WIDTH: 6,016^* bit
Graphics Processor GPU Name: GH100^*
Graphics Processor Architecture: Hopper^*
Render Config SM Count: 132^*
Graphics Features CUDA: 9^*
Render Config Tensor Cores: 528^*
Graphics Processor Process Size: 5^* nm
Graphics Processor Transistors: 80,000 million^*
Graphics Processor Die Size: 814^* mm²
Graphics Card Release Date: Mar 21st, 2023^*
Graphics Card Generation: Server Hopper (Hxx)^*
Graphics Card Successor: Server Blackwell^*
Graphics Card Production: Active^*
Name: H100 NVL 94 GB^*
Graphics Card Bus Interface: PCIe 5.0 x16^*
Clock Speeds Memory Clock: 1310 MHz 5.2 Gbps effective^*
Memory Memory Size: 94^* GB
Memory Memory Type: HBM3^*
Memory Memory Bus: 6,016^* bit
Memory Bandwidth: 3.94 TB/s^*
Render Config TMUs: 528^*
Top GRAPHICS PROCESSOR: GH100^*
Render Config ROPs: 24^*
Theoretical Performance Pixel Rate: 42.84 GPixel/s
Theoretical Performance Texture Rate: 942.5 GTexel/s
Board Design Slot Width: Dual-slot^*
Board Design TDP: 400^* W
Board Design Suggested PSU: 800^* W
Board Design Outputs: No outputs^*
Board Design Board Number: P1010 SKU 210^*
Graphics Features OpenCL: 3^*
source file: nvidia2023.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Server Ada^*
Board Design Length: 267 mm 10.5 inches^*
Board Design Power Connectors: 8-pin EPS^*
Graphics Processor Density: 98.3M / mm²^*
Board Design Height: 111 mm 4.4 inches^*
Top TMUS: 528^*
Top ROPS: 24^*
Clock Speeds Base Clock: 1,080^* MHz
Clock Speeds Boost Clock: 1,785^* MHz
Top CORES: 16,896^*
Render Config Shading Units: 16,896^*
Render Config L2 Cache: 50^* MB
Top MEMORY SIZE: 94^* GB
Theoretical Performance FP32 (float): 60.32^* TFLOPS
Theoretical Performance FP64 (double): 30.16 TFLOPS (1:2)
Render Config L1 Cache: 256 KB (per SM)^*
Theoretical Performance FP16 (half): 241.3 TFLOPS (4:1)
Top MEMORY TYPE: HBM3^*

* Provisional data