GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

Tesla V100 SXM2 16 GB

Graphics processor

Video memory: 16 GB^*
Memory bus: 4,096 bit^*
Rated memory bandwidth: 897 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: Volta^*
Process node: 12 nm^*
GPU cores: 5,120^*
GPU base clock: Reported value 1: 1,312 MHz^*
Reported value 2: 1,312 MHz^*
Reported value 3: 1,245 MHz^*
Reported value 4: 1,245 MHz^*
Reported GPU frequency: Reported value 1: 1,245 MHz^*
Reported value 2: 1,312 MHz^*
Graphics interface: PCIe 3.0 x16^*
Reported chip die area: 815 mm²^*
Chip/package TDP: 250 W^*
Transistors: 21,100 million^*
GPU boost clock: Reported value 1: 1,597 MHz^*
Reported value 2: 1,530 MHz^*
GPU L2 cache: 6 MB^*
Graphics processor: GV100^*
Texture mapping units: 320^*
Raster output units: 128^*
Streaming multiprocessors: 80^*
Tensor cores: 640^*
Chip foundry: TSMC^*
Card or module format: SXM Module^*
Declared GPU TDP: 250 W^*
Suggested system PSU: 600 W^*
External power connectors: None^*
DirectX / feature level: 12 (12_1)^*
OpenGL: 4.6^*
OpenCL: 3.0^*
Vulkan: 1.4^*
CUDA compute capability: 7.0^*
Shader model: 6.9^*

Memory & storage

Memory options: 16^*
Video memory: 16 GB^*
Video memory type: Reported value 1: HBM2^*
Reported value 2: HBM2^*
Reported value 3: HBM2^*
Reported value 4: HBM2^*
Reported value 5: HBM2^*
Reported value 6: HBM2^*
Reported value 7: HBM2^*
Reported value 8: HBM2^*
Reported value 9: GDDR6^*
Memory bus: 4,096 bit^*
Rated memory bandwidth: 897 GB/s^*

Power specifications

Thermal design power: 250 W^*

System configuration

Detailed specifications

Specifications 1 · 22 fields

Manufacturer: Nvidia^*
Manufacturer: Nvidia^*
GFLOPS: 15,670^* GFLOPS
GFLOPS: 16,350^* GFLOPS
TDP: 250^*
TDP: 250^*
Class: Datacenter^*
Class: Datacenter^*
Name: Tesla V100 SXM2 16 GB^*
Name: Tesla V100 SXM2 16 GB^*
Year: 2019^*
Year: 2017^*
Fab: 12^*
Fab: 12^*
Transistors (mln): 21,100^*
Transistors (mln): 21,100^*
Die size: 815^*
Die size: 815^*
Memory size: 16,384^*
Memory size: 16,384^*
Memory speed: 897^*
Memory speed: 250^*

Specifications 2 · 21 fields

GPU architecture — Tesla V100 SXM2 — 16 GB HBM2

Volta^*

Native hardware support: BF16 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Theoretical peak: FP16 tensor dense per GPU — Tesla V100 SXM2 — 16 GB HBM2

125^* TFLOPS

Theoretical peak: FP32 non-tensor dense per GPU — Tesla V100 SXM2 — 16 GB HBM2

15.7^* TFLOPS

Native hardware support: FP4 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Theoretical peak: FP64 non-tensor dense per GPU — Tesla V100 SXM2 — 16 GB HBM2

7.8^* TFLOPS

Native hardware support: FP64 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Native hardware support: FP6 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Native hardware support: FP8 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Native hardware support: INT8 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Native hardware support: TF32 tensor — Tesla V100 SXM2 — 16 GB HBM2

No^*

Physical configuration — Tesla V100 SXM2 — 16 GB HBM2

SXM2^*

GPU interconnect bandwidth (NVLink 2) bidirectional — Tesla V100 SXM2 — 16 GB HBM2

300^* GB/s

GPU interconnect bandwidth per direction — Tesla V100 SXM2 — 16 GB HBM2

150^* GB/s

Scope and conditions

Calculation: 300 / 2^*

PCIe interface declaration — Tesla V100 SXM2 — 16 GB HBM2

PCIe Gen3^*

Maximum board power — Tesla V100 SXM2 — 16 GB HBM2

300^* W

Peak memory bandwidth per GPU — Tesla V100 SXM2 — 16 GB HBM2

900^* GB/s

Memory interface width per GPU — Tesla V100 SXM2 — 16 GB HBM2

4,096^* bit

Memory capacity per GPU — Tesla V100 SXM2 — 16 GB HBM2

16^* GB

Memory technology — Tesla V100 SXM2 — 16 GB HBM2

HBM2^*

GPU model — Tesla V100 SXM2 — 16 GB HBM2

Tesla V100 SXM2^*

Specifications 3 · 26 fields

Foundry: TSMC^*
Foundry: TSMC^*
Vendor: NVIDIA^*
Vendor: NVIDIA^*
FP16 GFLOPS: 31,330^* GFLOPS
FP16 GFLOPS: 32,710^* GFLOPS
FP32 GFLOPS: 15,670^* GFLOPS
FP32 GFLOPS: 16,350.000000000002^* GFLOPS
FP64 GFLOPS: 7,834^* GFLOPS
FP64 GFLOPS: 8,177^* GFLOPS
Product: NVIDIA Tesla V100 SXM2 16 GB^*
Product: NVIDIA Tesla V100 SXM2 16 GB^*
Type: GPU^*
Type: GPU^*
Release Date: 2017-06-21^*
Release Date: 2019-11-26^*
Process Size (nm): 12^* nm
Process Size (nm): 12^* nm
TDP (W): 250^* W
TDP (W): 250^* W
Die Size (mm^2): 815^* mm²
Die Size (mm^2): 815^* mm²
Transistors (million): 21,100^*
Transistors (million): 21,100^*
Freq (MHz): 1,245^* MHz
Freq (MHz): 1,312^* MHz

Specifications 4 · 29 fields

proc transistors: 21,100 million^*
proc die size: 815^* mm²
cores: 5,120^*
tensor cores: 640^*
sm count: 80^*
base clock: 1,312^*
boost clock: 1,530^*
memory clock: 876^*
ram: 16^*
name: NVIDIA Tesla V100 SXM2 16 GB^*
ram type: HBM2^*
bus width: 4,096^*
bus interface: PCIe 3.0 x16^*
ram bandwidth: 897^* GB/s
fp16 performance: 31.33^*
fp32 performance: 15.67^*
fp64 performance: 7.834^*
tdp: 250^* W
suggested psu: 600^* W
slot width: SXM Module^*
api cuda: 7^*
is retail board: No^*
gpi value: 14.97^*
vendor: nvd^*
manufacturer: NVIDIA^*
arch name: Volta^*
card release date: 2017-06-21^*
proc foundry: TSMC^*
proc process size: 12^* nm

Specifications 5 · 39 fields

CUDA compute capability

7.0^*

DirectX / feature level

12 (12_1)^*

OpenCL

3.0^*

OpenGL

4.6^*

Shader model

6.9^*

Vulkan

1.4^*

Architecture

Volta^*

Graphics interface

PCIe 3.0 x16^*

Memory bus

4,096^* bit

Reported shader processors

5,120^*

Reported theoretical FP16 peak

31.33^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Reported theoretical FP32 peak

15.67^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Reported theoretical FP64 peak

7.834^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Declared L1 cache configuration

128 KB (per SM)^*

Declared GPU L2 cache

6 MB^*

Reported display outputs

No outputs^*

Theoretical pixel fill rate

195.8 GPixel/s^*

External power connectors

None^*

Reported chip die area

815 mm²^*

Chip foundry

TSMC^*

Process node declaration

12 nm^*

Transistors

21,100 million^*

Graphics processor

GV100^*

Reported video memory

16^* GB

Rated memory bandwidth

897.0 GB/s^*

Video memory type

HBM2^*

Raster output units

128^*

Reported shading units

5,120^*

Card or module format

SXM Module^*

Streaming multiprocessors

80^*

Suggested system PSU

600 W^*

2:4 tensor sparsity

No^*

Declared GPU TDP

250 W^*

Tensor cores

640^*

Theoretical texture fill rate

489.6 GTexel/s^*

Texture mapping units

320^*

GPU cores

5,120^*

Video memory

16^* GB

Video memory type

HBM2^*

Specifications 6 · 16 fields

Product Name: Tesla V100 SXM2 16 GB^*
Product Name: Tesla V100 SXM2 16 GB^*
GPU Chip: GV100^*
GPU Chip: GV100^*
Released: Jun 21st, 2017^*
Released: Nov 26th, 2019^*
Bus: PCIe 3.0 x16^*
Bus: PCIe 3.0 x16^*
Memory: 16 GB, HBM2, 4096 bit^*
Memory: 16 GB, HBM2, 4096 bit^*
GPU clock: 1,312^* MHz
GPU clock: 1,245^* MHz
Memory clock: 1,106^* MHz
Memory clock: 876^* MHz
Shaders / TMUs / ROPs: 5120 / 320 / 128^*
Shaders / TMUs / ROPs: 5120 / 320 / 128^*

Specifications 7 · 22 fields

Manufacturer: Nvidia^*
Manufacturer: Nvidia^*
GFLOPS: 15,670^* GFLOPS
GFLOPS: 16,350^* GFLOPS
TDP: 250^*
TDP: 250^*
Class: Datacenter^*
Class: Datacenter^*
Name: Tesla V100 SXM2 16 GB^*
Name: Tesla V100 SXM2 16 GB^*
Year: 2017^*
Year: 2019^*
Fab: 12^*
Fab: 12^*
Transistors (mln): 21,100^*
Transistors (mln): 21,100^*
Die size: 815^*
Die size: 815^*
Memory size: 16,384^*
Memory size: 16,384^*
Memory speed: 897^*
Memory speed: 250^*

Specifications 8 · 106 fields

Brand: NVIDIA^*
Brand: NVIDIA^*
Top BUS WIDTH: 4,096^* bit
Top BUS WIDTH: 4,096^* bit
Graphics Processor GPU Name: GV100^*
Graphics Processor GPU Name: GV100^*
Graphics Processor Architecture: Volta^*
Graphics Processor Architecture: Volta^*
Render Config SM Count: 80^*
Render Config SM Count: 80^*
Graphics Features CUDA: 7^*
Graphics Features CUDA: 7^*
Render Config Tensor Cores: 640^*
Render Config Tensor Cores: 640^*
Graphics Processor Process Size: 12^* nm
Graphics Processor Process Size: 12^* nm
Graphics Processor Transistors: 21,100 million^*
Graphics Processor Transistors: 21,100 million^*
Graphics Processor Die Size: 815^* mm²
Graphics Processor Die Size: 815^* mm²
Graphics Card Release Date: Nov 26th, 2019^*
Graphics Card Release Date: Jun 21st, 2017^*
Graphics Card Generation: Tesla Volta (Vxx)^*
Graphics Card Generation: Tesla Volta (Vxx)^*
Graphics Card Successor: Tesla Turing^*
Graphics Card Successor: Tesla Turing^*
Graphics Card Production: End-of-life^*
Graphics Card Production: End-of-life^*
Name: Tesla V100 SXM2 16 GB^*
Name: Tesla V100 SXM2 16 GB^*
Graphics Card Bus Interface: PCIe 3.0 x16^*
Graphics Card Bus Interface: PCIe 3.0 x16^*
Clock Speeds Memory Clock: 1106 MHz 2.2 Gbps effective^*
Clock Speeds Memory Clock: 876 MHz 1752 Mbps effective^*
Memory Memory Size: 16^* GB
Memory Memory Size: 16^* GB
Memory Memory Type: HBM2^*
Memory Memory Type: HBM2^*
Memory Memory Bus: 4,096^* bit
Memory Memory Bus: 4,096^* bit
Memory Bandwidth: 897^* GB/s
Memory Bandwidth: 1.13 TB/s^*
Render Config TMUs: 320^*
Render Config TMUs: 320^*
Top GRAPHICS PROCESSOR: GV100^*
Top GRAPHICS PROCESSOR: GV100^*
Render Config ROPs: 128^*
Render Config ROPs: 128^*
Theoretical Performance Pixel Rate: 204.4 GPixel/s
Theoretical Performance Pixel Rate: 195.8 GPixel/s
Theoretical Performance Texture Rate: 489.6 GTexel/s
Theoretical Performance Texture Rate: 511.0 GTexel/s
Board Design Slot Width: SXM Module^*
Board Design Slot Width: SXM Module^*
Board Design TDP: 250^* W
Board Design TDP: 250^* W
Board Design Suggested PSU: 600^* W
Board Design Suggested PSU: 600^* W
Board Design Outputs: No outputs^*
Board Design Outputs: No outputs^*
Board Design Board Number: PG503 SKU 202^*
Board Design Board Number: PG500^*
Graphics Features DirectX: 12 (12_1)^*
Graphics Features DirectX: 12 (12_1)^*
Graphics Features OpenGL: 4.6^*
Graphics Features OpenGL: 4.6^*
Graphics Features OpenCL: 3^*
Graphics Features OpenCL: 3^*
Graphics Features Vulkan: 1.3^*
Graphics Features Vulkan: 1.3^*
source file: nvidia2019.json^*
source file: nvidia2017.json^*
Graphics Processor Foundry: TSMC^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: Tesla Pascal^*
Graphics Card Predecessor: Tesla Pascal^*
Graphics Processor Density: 25.9M / mm²^*
Graphics Processor Density: 25.9M / mm²^*
Top TMUS: 320^*
Top TMUS: 320^*
Top ROPS: 128^*
Top ROPS: 128^*
Clock Speeds Base Clock: 1,312^* MHz
Clock Speeds Base Clock: 1,245^* MHz
Clock Speeds Boost Clock: 1,597^* MHz
Clock Speeds Boost Clock: 1,530^* MHz
Graphics Features Shader Model: 6.8^*
Graphics Features Shader Model: 6.8^*
Top CORES: 5,120^*
Top CORES: 5,120^*
Render Config Shading Units: 5,120^*
Render Config Shading Units: 5,120^*
Render Config L2 Cache: 6^* MB
Render Config L2 Cache: 6^* MB
Top MEMORY SIZE: 16^* GB
Top MEMORY SIZE: 16^* GB
Theoretical Performance FP32 (float): 15.67^* TFLOPS
Theoretical Performance FP32 (float): 16.35^* TFLOPS
Theoretical Performance FP64 (double): 8.177 TFLOPS (1:2)
Theoretical Performance FP64 (double): 7.834 TFLOPS (1:2)
Render Config L1 Cache: 128 KB (per SM)^*
Render Config L1 Cache: 128 KB (per SM)^*
Theoretical Performance FP16 (half): 31.33 TFLOPS (2:1)
Theoretical Performance FP16 (half): 32.71 TFLOPS (2:1)
Top MEMORY TYPE: HBM2^*
Top MEMORY TYPE: HBM2^*

Specifications 9 · 54 fields

manufacturer: NVIDIA^*
manufacturer: NVIDIA^*
manufacturer: NVIDIA^*
manufacturer: NVIDIA^*
rop: 96^*
rop: 48^*
rop: 128^*
rop: 128^*
igp: No^*
igp: No^*
igp: No^*
igp: No^*
bus: PCIe 3.0 x16^*
bus: PCIe 3.0 x16^*
bus: PCIe 3.0 x16^*
bus: PCIe 4.0 x16^*
memType: HBM2^*
memType: HBM2^*
memType: HBM2^*
memType: GDDR6^*
gpuChip: GA106^*
gpuChip: GP100^*
gpuChip: GV100^*
gpuChip: GV100^*
productName: Tesla V100 SXM2 16 GB^*
productName: Tesla V100 SXM2 16 GB^*
productName: Tesla V100 SXM2 16 GB^*
productName: Tesla V100 SXM2 16 GB^*
releaseYear: 2,019^*
releaseYear: 2,017^*
releaseYear: 2,019^*
releaseYear: 2,017^*
memSize: 16^*
memSize: 16^*
memSize: 16^*
memSize: 16^*
memBusWidth: 4,096^*
memBusWidth: 4,096^*
gpuClock: 1,304^*
gpuClock: 1,245^*
gpuClock: 1,312^*
gpuClock: 1,320^*
memClock: 876^*
memClock: 1,875^*
memClock: 1,106^*
memClock: 715^*
unifiedShader: 5,120^*
unifiedShader: 5,120^*
unifiedShader: 3,584^*
unifiedShader: 3,584^*
tmu: 320^*
tmu: 224^*
tmu: 112^*
tmu: 320^*

* Provisional data