NVIDIA A100 PCIe

Graphics processor

Memory bus: 5,120 bit^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Ampere^*
Process node: 7 nm^*
Reported GPU frequency: 765 MHz^*
Reported chip die area: 826 mm²^*
Chip/package TDP: 250 W^*
Transistors: 54,200 million^*

Memory & storage

Memory bus: 5,120 bit^*

System configuration

Detailed specifications

Specifications 1 · 40 fields

GPU architecture — NVIDIA A100 80GB PCIe — 80 GB HBM2e: Ampere^*
GPU architecture — NVIDIA A100 40GB PCIe — 40 GB HBM2: Ampere^*
Theoretical peak: BF16 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 312^* TFLOPS
Theoretical peak: BF16 tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 312^* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 312^* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 312^* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 19.5^* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 19.5^* TFLOPS
Native hardware support: FP4 tensor — NVIDIA A100 40GB PCIe — 40 GB HBM2: No^*
Native hardware support: FP4 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e: No^*
Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 9.7^* TFLOPS
Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 9.7^* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 19.5^* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 19.5^* TFLOPS
Native hardware support: FP6 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e: No^*
Native hardware support: FP6 tensor — NVIDIA A100 40GB PCIe — 40 GB HBM2: No^*
Native hardware support: FP8 tensor — NVIDIA A100 40GB PCIe — 40 GB HBM2: No^*
Native hardware support: FP8 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e: No^*
Theoretical peak: INT8 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 624^* TOPS
Theoretical peak: INT8 tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 624^* TOPS
Theoretical peak: TF32 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 156^* TFLOPS
Theoretical peak: TF32 tensor dense per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 156^* TFLOPS
Physical configuration — NVIDIA A100 80GB PCIe — 80 GB HBM2e: PCIe, dual-slot air-cooled or single-slot liquid-cooled^*
Physical configuration — NVIDIA A100 40GB PCIe — 40 GB HBM2: PCIe, dual-slot FHFL^*
GPU interconnect bandwidth (NVLink 3) — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 600^* GB/s
GPU interconnect bandwidth (NVLink 3) — NVIDIA A100 40GB PCIe — 40 GB HBM2: 600^* GB/s
PCIe interface declaration — NVIDIA A100 80GB PCIe — 80 GB HBM2e: PCIe Gen4^*
PCIe interface declaration — NVIDIA A100 40GB PCIe — 40 GB HBM2: PCIe Gen4 x16^*
Maximum board power — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 300^* W
Maximum board power — NVIDIA A100 40GB PCIe — 40 GB HBM2: 250^* W
Peak memory bandwidth per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 1,935^* GB/s
Peak memory bandwidth per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 1,555^* GB/s
Memory interface width per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 5,120^* bit
Memory interface width per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 5,120^* bit
Memory capacity per GPU — NVIDIA A100 40GB PCIe — 40 GB HBM2: 40^* GB
Memory capacity per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e: 80^* GB
Memory technology — NVIDIA A100 40GB PCIe — 40 GB HBM2: HBM2^*
Memory technology — NVIDIA A100 80GB PCIe — 80 GB HBM2e: HBM2e^*
GPU model — NVIDIA A100 80GB PCIe — 80 GB HBM2e: NVIDIA A100 80GB PCIe^*
GPU model — NVIDIA A100 40GB PCIe — 40 GB HBM2: NVIDIA A100 40GB PCIe^*

Specifications 2 · 13 fields

Foundry: TSMC^*
Vendor: NVIDIA^*
FP16 GFLOPS: 77,970^* GFLOPS
FP32 GFLOPS: 19,490^* GFLOPS
FP64 GFLOPS: 9,746^* GFLOPS
Product: NVIDIA A100 PCIe^*
Type: GPU^*
Release Date: 2020-06-22^*
Process Size (nm): 7^* nm
TDP (W): 250^* W
Die Size (mm^2): 826^* mm²
Transistors (million): 54,200^*
Freq (MHz): 765^* MHz

* Provisional data