A100 SXM4 40 GB

Graphics processor

Video memory: 40 GB^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 1,555 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Ampere^*
Process node: 7 nm^*
GPU base clock: 1,095 MHz^*
GPU boost clock: 1,410 MHz^*

Memory & storage

Video memory: 40 GB^*
Video memory type: Reported value 1: GDDR5X^*
Reported value 2: HBM2e^*
Reported value 3: HBM2e^*
Memory bus: 5,120 bit^*
Rated memory bandwidth: 1,555 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 20 fields

GPU architecture — NVIDIA A100 40GB SXM — 40 GB HBM2: Ampere^*
Theoretical peak: BF16 tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 312^* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 312^* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 19.5^* TFLOPS
Native hardware support: FP4 tensor — NVIDIA A100 40GB SXM — 40 GB HBM2: No^*
Theoretical peak: FP64 non-tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 9.7^* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 19.5^* TFLOPS
Native hardware support: FP6 tensor — NVIDIA A100 40GB SXM — 40 GB HBM2: No^*
Native hardware support: FP8 tensor — NVIDIA A100 40GB SXM — 40 GB HBM2: No^*
Theoretical peak: INT8 tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 624^* TOPS
Theoretical peak: TF32 tensor dense per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 156^* TFLOPS
Physical configuration — NVIDIA A100 40GB SXM — 40 GB HBM2: SXM4^*
GPU interconnect bandwidth (NVLink 3) — NVIDIA A100 40GB SXM — 40 GB HBM2: 600^* GB/s
PCIe interface declaration — NVIDIA A100 40GB SXM — 40 GB HBM2: PCIe Gen4^*
Maximum board power — NVIDIA A100 40GB SXM — 40 GB HBM2: 400^* W
Peak memory bandwidth per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 1,555^* GB/s
Memory interface width per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 5,120^* bit
Memory capacity per GPU — NVIDIA A100 40GB SXM — 40 GB HBM2: 40^* GB
Memory technology — NVIDIA A100 40GB SXM — 40 GB HBM2: HBM2^*
GPU model — NVIDIA A100 40GB SXM — 40 GB HBM2: NVIDIA A100 40GB SXM^*

Specifications 2 · 8 fields

Product Name: A100 SXM4 40 GB^*
GPU Chip: GA100^*
Released: May 14th, 2020^*
Bus: PCIe 4.0 x16^*
Memory: 40 GB, HBM2e, 5120 bit^*
GPU clock: 1,095^* MHz
Memory clock: 1,215^* MHz
Shaders TMUs ROPs: 6912 / 432 / 160^*

Specifications 3 · 8 fields

Product Name: A100 SXM4 40 GB^*
GPU Chip: GA100^*
Released: May 14th, 2020^*
Bus: PCIe 4.0 x16^*
Memory: 40 GB, HBM2e, 5120 bit^*
GPU clock: 1,095^* MHz
Memory clock: 1,215^* MHz
Shaders / TMUs / ROPs: 6912 / 432 / 160^*

Specifications 4 · 52 fields

Brand: NVIDIA^*
Top BUS WIDTH: 5,120^* bit
Graphics Processor GPU Name: GA100^*
Graphics Processor Architecture: Ampere^*
Render Config SM Count: 108^*
Graphics Features CUDA: 8^*
Render Config Tensor Cores: 432^*
Theoretical Performance BF16: 311.84 TFLOPS (16:1)
Graphics Processor Process Size: 7^* nm
Theoretical Performance TF32: 155.92 TFLOPs (8:1)
Theoretical Performance FP64 Tensor: 19.49 TFLOPS (1:1)
Graphics Processor Transistors: 54,200 million^*
Graphics Processor Die Size: 826^* mm²
Graphics Card Release Date: May 14th, 2020^*
Graphics Card Generation: Server Ampere (Axx)^*
Graphics Card Successor: Server Ada^*
Graphics Card Production: Active^*
Name: A100 SXM4 40 GB^*
Graphics Card Bus Interface: PCIe 4.0 x16^*
Clock Speeds Memory Clock: 1215 MHz 2.4 Gbps effective^*
Memory Memory Size: 40^* GB
Memory Memory Type: HBM2e^*
Memory Memory Bus: 5,120^* bit
Memory Bandwidth: 1.56 TB/s^*
Render Config TMUs: 432^*
Top GRAPHICS PROCESSOR: GA100^*
Render Config ROPs: 160^*
Theoretical Performance Pixel Rate: 225.6 GPixel/s
Theoretical Performance Texture Rate: 609.1 GTexel/s
Board Design Slot Width: SXM Module^*
Board Design TDP: 400^* W
Board Design Suggested PSU: 800^* W
Board Design Outputs: No outputs^*
Graphics Features OpenCL: 3^*
source file: nvidia2020.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Tesla Turing^*
Graphics Processor Density: 65.6M / mm²^*
Top TMUS: 432^*
Graphics Processor Chip Package: BGA-2743^*
Top ROPS: 160^*
Clock Speeds Base Clock: 1,095^* MHz
Clock Speeds Boost Clock: 1,410^* MHz
Top CORES: 6,912^*
Render Config Shading Units: 6,912^*
Render Config L2 Cache: 40^* MB
Top MEMORY SIZE: 40^* GB
Theoretical Performance FP32 (float): 19.49^* TFLOPS
Theoretical Performance FP64 (double): 9.746 TFLOPS (1:2)
Render Config L1 Cache: 192 KB (per SM)^*
Theoretical Performance FP16 (half): 77.97 TFLOPS (4:1)
Top MEMORY TYPE: HBM2e^*

Specifications 5 · 27 fields

manufacturer: NVIDIA^*
manufacturer: NVIDIA^*
rop: 96^*
rop: 160^*
igp: No^*
igp: No^*
bus: PCIe 3.0 x16^*
bus: PCIe 4.0 x16^*
memType: GDDR5X^*
memType: HBM2e^*
gpuChip: GP102^*
gpuChip: GA100^*
productName: A100 SXM4 40 GB^*
productName: A100 SXM4 40 GB^*
releaseYear: 2,020^*
releaseYear: 2,020^*
memSize: 40^*
memSize: 40^*
memBusWidth: 5,120^*
gpuClock: 1,405^*
gpuClock: 1,095^*
memClock: 1,215^*
memClock: 1,426^*
unifiedShader: 6,912^*
unifiedShader: 3,840^*
tmu: 432^*
tmu: 240^*

* Provisional data