GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

NVIDIA H100 NVL

Graphics processor

Video memory: 94 GB^*
Memory bus: 6,016 bit^*
Rated memory bandwidth: 3,938 GB/s^*

Benchmark results

Geekbench GPU (reported compilation) · version unreported · OpenCL315,542^*Platform unreported Compare results

Processing & platform

Architecture: Hopper^*

Memory & storage

Video memory: 94 GB^*
Video memory type: HBM3^*
Memory bus: 6,016 bit^*
Rated memory bandwidth: 3,938 GB/s^*

Power specifications

Thermal design power: 400 W^*

System configuration

Detailed specifications

Specifications 1 · 27 fields

GPU architecture — NVIDIA H100 NVL — 94 GB HBM3

Hopper^*

Calculated theoretical peak: BF16 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: BF16 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,671^* TFLOPS

Calculated theoretical peak: FP16 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

835.5^* TFLOPS

Scope and conditions

Calculation: 1671 / 2^*

Theoretical peak: FP16 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,671^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

60^* TFLOPS

Native hardware support: FP4 tensor — NVIDIA H100 NVL — 94 GB HBM3

No^*

Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

30^* TFLOPS

Theoretical peak: FP64 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

60^* TFLOPS

Native hardware support: FP6 tensor — NVIDIA H100 NVL — 94 GB HBM3

No^*

Calculated theoretical peak: FP8 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,670.5^* TFLOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: FP8 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,341^* TFLOPS

Calculated theoretical peak: INT8 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

1,670.5^* TOPS

Scope and conditions

Calculation: 3341 / 2^*

Theoretical peak: INT8 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,341^* TOPS

Calculated theoretical peak: TF32 tensor dense per GPU — NVIDIA H100 NVL — 94 GB HBM3

417.5^* TFLOPS

Scope and conditions

Calculation: 835 / 2^*

Theoretical peak: TF32 tensor with sparsity per GPU — NVIDIA H100 NVL — 94 GB HBM3

835^* TFLOPS

Physical configuration — NVIDIA H100 NVL — 94 GB HBM3

NVL (PCIe dual-slot, NVLink bridge)^*

GPU interconnect bandwidth (NVLink 4 (three NVLink bridges, two cards)) bidirectional — NVIDIA H100 NVL — 94 GB HBM3

600^* GB/s

GPU interconnect bandwidth per direction — NVIDIA H100 NVL — 94 GB HBM3

300^* GB/s

Scope and conditions

Calculation: 600 / 2^*

PCIe interface declaration — NVIDIA H100 NVL — 94 GB HBM3

PCIe Gen5: 128GB/s^*

Maximum board power — NVIDIA H100 NVL — 94 GB HBM3

400^* W

Peak memory bandwidth per GPU — NVIDIA H100 NVL — 94 GB HBM3

3,938^* GB/s

Memory interface width per GPU — NVIDIA H100 NVL — 94 GB HBM3

6,016^* bit

Memory capacity per GPU — NVIDIA H100 NVL — 94 GB HBM3

94^* GB

Memory reported in a documented driver sample — NVIDIA H100 NVL — 94 GB HBM3

95,830^* MiB

Scope and conditions

Configuration: Documented driver sample; not nominal VRAM capacity.^*

Memory technology — NVIDIA H100 NVL — 94 GB HBM3

HBM3^*

GPU model — NVIDIA H100 NVL — 94 GB HBM3

NVIDIA H100 NVL^*

Specifications 2 · 7 fields

Form factor declaration

PCIe (dual-slot)^*

Graphics model

H100 NVL^*

Full graphics designation

NVIDIA H100 NVL^*

Manufacturer

NVIDIA^*

Memory capacity declaration

94^* GB

Scope and conditions

native_context

Capacity unit base: Not independently established^*

Memory technology

HBM3^*

Thermal design power declaration

400^* W

Specifications 3 · 1 fields

Nominal GPU Memory

94^* GB · HBM3^*

Scope and conditions

native_context

Memory scope: Nominal per-GPU memory; not the total CPU + GPU module memory or runtime-available capacity^*
memory role: nominal_release_inventory^*
not dedicated VRAM for shared memory systems: Yes^*
not runtime available or HGX usable capacity: Yes^*

Specifications 4 · 2 fields

Device

NVIDIA H100 NVL^*

Scope and conditions

benchmark_context

suite: Geekbench GPU (reported compilation)^*
backend_columns: CUDA^*
Metal^*
OpenCL^*
Vulkan^*
test_configuration_verified: No^*
comparable: No^*

OpenCL

315,542^*

Scope and conditions

benchmark_context

suite: Geekbench GPU (reported compilation)^*
backend_columns: CUDA^*
Metal^*
OpenCL^*
Vulkan^*
test_configuration_verified: No^*
comparable: No^*

* Provisional data