GeekRadar / The comparison desk

COMPARE.

GPU

NVIDIA

NVIDIA RTX PRO 6000 Blackwell

Graphics processor

Video memory: 96 GB^*
Memory bus: 512 bit^*
Rated memory bandwidth: 1,790 GB/s^*

Benchmark results

LLM Inference: Geekbench AI: Geekbench AI Half Precision (fp16) · version unreported · score54,998^* pointsPlatform unreported Compare results
LLM Inference: Geekbench AI: Geekbench AI Quantized (int8) · version unreported · score28,646^* pointsPlatform unreported Compare results
LLM Inference: Geekbench AI: Geekbench AI Single Precision (fp32) · version unreported · score38,235^* pointsPlatform unreported Compare results
LLM Inference: llama.cpp Bench: llama 7B Q4_0 (Q4_0) · version unreported · score104.38^* tokens/sPlatform unreported Compare results
LLM Inference: llama.cpp Bench: llama-2-7b-Q4_0 (Q4_0) · version unreported · score104.38^* tokens/sPlatform unreported Compare results

Processing & platform

Architecture: Blackwell 2.0^*
Process node: 5 nm^*
GPU cores: 24,064^*
Graphics interface: PCIe 5.0 x16^*
Reported chip die area: 750 mm²^*
Transistors: 92,200 million^*
GPU L2 cache: 128 MB^*
Graphics processor: GB202^*
Texture mapping units: 752^*
Raster output units: 192^*
Streaming multiprocessors: 188^*
Tensor cores: 752^*
Ray tracing cores: 188^*
Chip foundry: TSMC^*
Card or module format: Dual-slot^*
Declared GPU TDP: 600 W^*
Suggested system PSU: 1,000 W^*
External power connectors: 1x 16-pin^*
DirectX / feature level: 12 Ultimate (12_2)^*
OpenGL: 4.6^*
OpenCL: 3.0^*
Vulkan: 1.4^*
CUDA compute capability: 12.0^*
Shader model: 6.9^*

Memory & storage

Memory options: 96^*
Video memory: 96 GB^*
Video memory type: GDDR7^*
Memory bus: 512 bit^*
Rated memory bandwidth: 1,790 GB/s^*

Power specifications

Thermal design power: 600 W^*

System configuration

Detailed specifications

Specifications 1 · 46 fields

proc transistors

92,200 million^*

proc die size

750^* mm²

cores

24,064^*

tensor cores

752^*

rt cores

188^*

sm count

188^*

base clock

1,590^*

boost clock

2,617^*

memory clock

1,750^*

ram

96^*

name

NVIDIA RTX PRO 6000 Blackwell^*

test name Graphics benchmark result

LLM Inference: Geekbench AI: Geekbench AI Half Precision (fp16)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

test name Graphics benchmark result

LLM Inference: llama.cpp Bench: llama-2-7b-Q4_0 (Q4_0)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

test name Graphics benchmark result

LLM Inference: llama.cpp Bench: llama 7B Q4_0 (Q4_0)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

test name Graphics benchmark result

LLM Inference: Geekbench AI: Geekbench AI Quantized (int8)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

test name Graphics benchmark result

LLM Inference: Geekbench AI: Geekbench AI Single Precision (fp32)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

ram type

GDDR7^*

bus width

512^*

bus interface

PCIe 5.0 x16^*

ram bandwidth

1.79 TB/s^*

fp16 performance

126^*

fp32 performance

126^*

fp64 performance

1.968^*

score Graphics benchmark result

54,998^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

score Graphics benchmark result

38,235^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

score Graphics benchmark result

104.38^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

score Graphics benchmark result

104.38^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

score Graphics benchmark result

28,646^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

tdp

600^* W

suggested psu

1,000^* W

slot width

Dual-slot^*

power connectors

1x 16-pin^*

api cuda

12^*

is retail board

No^*

gpi value

57.47^*