GeekRadar / The comparison desk
COMPARE.
GPU
NVIDIA

A100 PCIe 80 GB

Graphics processor

Video memory
80 GB*
Memory bus
5,120 bit*
Rated memory bandwidth
1,935 GB/s*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture
Ampere*
Process node
7 nm*
GPU base clock
1,065 MHz*
GPU boost clock
1,410 MHz*

Memory & storage

Video memory
80 GB*
Video memory type
Reported value 1: HBM2e*
Reported value 2: HBM2e*
Reported value 3: GDDR6*
Memory bus
5,120 bit*
Rated memory bandwidth
1,935 GB/s*

System configuration

Detailed specifications

Specifications 1 · 20 fields
GPU architecture — NVIDIA A100 80GB PCIe — 80 GB HBM2e
Ampere*
Theoretical peak: BF16 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
312* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
312* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
19.5* TFLOPS
Native hardware support: FP4 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e
No*
Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
9.7* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
19.5* TFLOPS
Native hardware support: FP6 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e
No*
Native hardware support: FP8 tensor — NVIDIA A100 80GB PCIe — 80 GB HBM2e
No*
Theoretical peak: INT8 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
624* TOPS
Theoretical peak: TF32 tensor dense per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
156* TFLOPS
Physical configuration — NVIDIA A100 80GB PCIe — 80 GB HBM2e
PCIe, dual-slot air-cooled or single-slot liquid-cooled*
GPU interconnect bandwidth (NVLink 3) — NVIDIA A100 80GB PCIe — 80 GB HBM2e
600* GB/s
PCIe interface declaration — NVIDIA A100 80GB PCIe — 80 GB HBM2e
PCIe Gen4*
Maximum board power — NVIDIA A100 80GB PCIe — 80 GB HBM2e
300* W
Peak memory bandwidth per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
1,935* GB/s
Memory interface width per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
5,120* bit
Memory capacity per GPU — NVIDIA A100 80GB PCIe — 80 GB HBM2e
80* GB
Memory technology — NVIDIA A100 80GB PCIe — 80 GB HBM2e
HBM2e*
GPU model — NVIDIA A100 80GB PCIe — 80 GB HBM2e
NVIDIA A100 80GB PCIe*
Specifications 2 · 8 fields
Product Name
A100 PCIe 80 GB*
GPU Chip
GA100*
Released
Jun 28th, 2021*
Bus
PCIe 4.0 x16*
Memory
80 GB, HBM2e, 5120 bit*
GPU clock
1,065* MHz
Memory clock
1,593* MHz
Shaders TMUs ROPs
6912 / 432 / 160*
Specifications 3 · 8 fields
Product Name
A100 PCIe 80 GB*
GPU Chip
GA100*
Released
Jun 28th, 2021*
Bus
PCIe 4.0 x16*
Memory
80 GB, HBM2e, 5120 bit*
GPU clock
1,065* MHz
Memory clock
1,512* MHz
Shaders / TMUs / ROPs
6912 / 432 / 160*
Specifications 4 · 56 fields
Brand
NVIDIA*
Top BUS WIDTH
5,120* bit
Graphics Processor GPU Name
GA100*
Graphics Processor Architecture
Ampere*
Render Config SM Count
108*
Graphics Features CUDA
8*
Render Config Tensor Cores
432*
Theoretical Performance BF16
311.84 TFLOPS (16:1)
Graphics Processor Process Size
7* nm
Theoretical Performance TF32
155.92 TFLOPs (8:1)
Theoretical Performance FP64 Tensor
19.49 TFLOPS (1:1)
Graphics Processor Transistors
54,200 million*
Graphics Processor Die Size
826* mm²
Graphics Card Release Date
Jun 28th, 2021*
Graphics Card Generation
Server Ampere (Axx)*
Graphics Card Successor
Server Ada*
Graphics Card Production
Active*
Name
A100 PCIe 80 GB*
Graphics Card Bus Interface
PCIe 4.0 x16*
Clock Speeds Memory Clock
1512 MHz 3 Gbps effective*
Memory Memory Size
80* GB
Memory Memory Type
HBM2e*
Memory Memory Bus
5,120* bit
Memory Bandwidth
1.94 TB/s*
Render Config TMUs
432*
Top GRAPHICS PROCESSOR
GA100*
Render Config ROPs
160*
Theoretical Performance Pixel Rate
225.6 GPixel/s
Theoretical Performance Texture Rate
609.1 GTexel/s
Board Design Slot Width
Dual-slot*
Board Design TDP
300* W
Board Design Suggested PSU
700* W
Board Design Outputs
No outputs*
Board Design Board Number
P1001 SKU 200*
Graphics Features OpenCL
3*
source file
nvidia2021.json*
Graphics Processor Foundry
TSMC*
Graphics Card Predecessor
Tesla Turing*
Board Design Length
267 mm 10.5 inches*
Board Design Power Connectors
8-pin EPS*
Graphics Processor Density
65.6M / mm²*
Board Design Height
111 mm 4.4 inches*
Top TMUS
432*
Graphics Processor Chip Package
BGA-2743*
Top ROPS
160*
Clock Speeds Base Clock
1,065* MHz
Clock Speeds Boost Clock
1,410* MHz
Top CORES
6,912*
Render Config Shading Units
6,912*
Render Config L2 Cache
80* MB
Top MEMORY SIZE
80* GB
Theoretical Performance FP32 (float)
19.49* TFLOPS
Theoretical Performance FP64 (double)
9.746 TFLOPS (1:2)
Render Config L1 Cache
192 KB (per SM)*
Theoretical Performance FP16 (half)
77.97 TFLOPS (4:1)
Top MEMORY TYPE
HBM2e*
Specifications 5 · 27 fields
manufacturer
NVIDIA*
manufacturer
NVIDIA*
rop
48*
rop
160*
igp
No*
igp
No*
bus
PCIe 4.0 x16*
bus
PCIe 4.0 x16*
memType
HBM2e*
memType
GDDR6*
gpuChip
GA106*
gpuChip
GA100*
productName
A100 PCIe 80 GB*
productName
A100 PCIe 80 GB*
releaseYear
2,021*
releaseYear
2,021*
memSize
80*
memSize
80*
memBusWidth
5,120*
gpuClock
1,065*
gpuClock
900*
memClock
1,750*
memClock
1,593*
unifiedShader
3,840*
unifiedShader
6,912*
tmu
432*
tmu
120*

* Provisional data