H100 PCIe 96 GB

Graphics processor

Video memory: 96 GB^*
Memory bus: 5,120 bit^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Hopper^*
Process node: 5 nm^*
GPU base clock: 1,665 MHz^*
GPU boost clock: 1,837 MHz^*

Memory & storage

Video memory: 96 GB^*
Video memory type: Reported value 1: GDDR6^*
Reported value 2: HBM3^*
Memory bus: 5,120 bit^*

System configuration

Detailed specifications

Specifications 1 · 8 fields

Product Name: H100 PCIe 96 GB^*
GPU Chip: GH100^*
Released: Mar 22nd, 2022^*
Bus: PCIe 5.0 x16^*
Memory: 96 GB, HBM3, 5120 bit^*
GPU clock: 1,665^* MHz
Memory clock: 1,313^* MHz
Shaders / TMUs / ROPs: 16896 / 528 / 24^*

Specifications 2 · 52 fields

Brand: NVIDIA^*
Top BUS WIDTH: 5,120^* bit
Graphics Processor GPU Name: GH100^*
Graphics Processor Architecture: Hopper^*
Render Config SM Count: 132^*
Graphics Features CUDA: 9^*
Render Config Tensor Cores: 528^*
Graphics Processor Process Size: 5^* nm
Graphics Processor Transistors: 80,000 million^*
Graphics Processor Die Size: 814^* mm²
Graphics Card Release Date: Mar 21st, 2023^*
Graphics Card Generation: Server Hopper (Hxx)^*
Graphics Card Successor: Server Blackwell^*
Graphics Card Production: Active^*
Name: H100 PCIe 96 GB^*
Graphics Card Bus Interface: PCIe 5.0 x16^*
Clock Speeds Memory Clock: 1313 MHz 5.3 Gbps effective^*
Memory Memory Size: 96^* GB
Memory Memory Type: HBM3^*
Memory Memory Bus: 5,120^* bit
Memory Bandwidth: 3.36 TB/s^*
Render Config TMUs: 528^*
Top GRAPHICS PROCESSOR: GH100^*
Render Config ROPs: 24^*
Theoretical Performance Pixel Rate: 44.09 GPixel/s
Theoretical Performance Texture Rate: 969.9 GTexel/s
Board Design Slot Width: Dual-slot^*
Board Design TDP: 700^* W
Board Design Suggested PSU: 1,100^* W
Board Design Outputs: No outputs^*
Board Design Board Number: PG520^*
Graphics Features OpenCL: 3^*
source file: nvidia2023.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Server Ada^*
Board Design Length: 268 mm 10.6 inches^*
Board Design Power Connectors: 8-pin EPS^*
Graphics Processor Density: 98.3M / mm²^*
Board Design Height: 111 mm 4.4 inches^*
Top TMUS: 528^*
Top ROPS: 24^*
Clock Speeds Base Clock: 1,665^* MHz
Clock Speeds Boost Clock: 1,837^* MHz
Top CORES: 16,896^*
Render Config Shading Units: 16,896^*
Render Config L2 Cache: 50^* MB
Top MEMORY SIZE: 96^* GB
Theoretical Performance FP32 (float): 62.08^* TFLOPS
Theoretical Performance FP64 (double): 31.04 TFLOPS (1:2)
Render Config L1 Cache: 256 KB (per SM)^*
Theoretical Performance FP16 (half): 248.3 TFLOPS (4:1)
Top MEMORY TYPE: HBM3^*

Specifications 3 · 14 fields

manufacturer: NVIDIA^*
rop: 96^*
igp: No^*
bus: PCIe 4.0 x16^*
memType: GDDR6^*
gpuChip: GA102^*
productName: H100 PCIe 96 GB^*
releaseYear: 2,023^*
memSize: 96^*
memBusWidth: 5,120^*
gpuClock: 885^*
memClock: 1,563^*
unifiedShader: 9,216^*
tmu: 288^*

* Provisional data