GeekRadar / The comparison desk

COMPARE.

GPU

AMD

Radeon Instinct MI250

Graphics processor

Video memory: 128 GB^*
Memory bus: 8,192 bit^*

Benchmark results

LLM Inference: llama.cpp Bench: llama-2-7b-Q4_0 (Q4_0) · version unreported · score63.94^* tokens/sPlatform unreported Compare results

Processing & platform

Architecture: CDNA 2.0^*
Process node: 6 nm^*
GPU base clock: 1,000 MHz^*
GPU boost clock: 1,700 MHz^*

Memory & storage

Memory options: 128^*
Video memory: 128 GB^*
Video memory type: Reported value 1: HBM2e^*
Reported value 2: HBM2e^*
Reported value 3: GDDR6^*
Reported value 4: HBM2e^*
Memory bus: 8,192 bit^*

Power specifications

Thermal design power: 500 W^*

System configuration

Detailed specifications

Specifications 1 · 8 fields

Product Name: Radeon Instinct MI250^*
GPU Chip: Aldebaran^*
Released: Nov 8th, 2021^*
Bus: PCIe 4.0 x16^*
Memory: 128 GB, HBM2e, 8192 bit^*
GPU clock: 1,000^* MHz
Memory clock: 1,600^* MHz
Shaders TMUs ROPs: 13312 / 832 / 0^*

Specifications 2 · 30 fields

proc transistors

58,200 million^*

proc die size

724^* mm²

cores

13,312^*

base clock

1,000^*

boost clock

1,700^*

memory clock

1,600^*

ram

128^*

name

AMD Radeon Instinct MI250^*

test name Graphics benchmark result

LLM Inference: llama.cpp Bench: llama-2-7b-Q4_0 (Q4_0)^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

ram type

HBM2e^*

bus width

8,192^*

bus interface

PCIe 4.0 x16^*

ram bandwidth

3.28 TB/s^*

fp16 performance

362.1^*

fp32 performance

45.26^*

fp64 performance

45.26^*

score Graphics benchmark result

63.94^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

tdp

500^* W

suggested psu

900^* W

slot width

Dual-slot^*

power connectors

2x 8-pin^*

is retail board

No^*

gpi value

50.89^*

unit Graphics benchmark result

tokens/s^*

Scope and conditions

benchmark_context

suite: Per-row third-party test name^*
test_configuration_verified: No^*
comparable: No^*

vendor

amd^*

manufacturer

AMD^*

arch name

CDNA 2.0^*

card release date

2021-11-08^*

proc foundry

TSMC^*

proc process size

6^* nm

Specifications 3 · 8 fields

Product Name: Radeon Instinct MI250^*
GPU Chip: Aldebaran^*
Released: Nov 8th, 2021^*
Bus: PCIe 4.0 x16^*
Memory: 128 GB, HBM2e, 8192 bit^*
GPU clock: 1,000^* MHz
Memory clock: 1,600^* MHz
Shaders / TMUs / ROPs: 13312 / 832 / 0^*

Specifications 4 · 49 fields

Brand: AMD^*
Top BUS WIDTH: 8,192^* bit
Render Config MCM: 2^*
Graphics Processor GPU Name: Aldebaran^*
Graphics Processor Architecture: CDNA 2.0^*
Graphics Processor Process Size: 6^* nm
Graphics Processor Transistors: 58,200 million^*
Graphics Processor Die Size: 724^* mm²
Graphics Card Release Date: Nov 8th, 2021^*
Graphics Card Generation: Radeon Instinct (MIx)^*
Graphics Card Production: Active^*
Name: Radeon Instinct MI250^*
Graphics Card Bus Interface: PCIe 4.0 x16^*
Clock Speeds Memory Clock: 1600 MHz 3.2 Gbps effective^*
Memory Memory Size: 128^* GB
Memory Memory Type: HBM2e^*
Memory Memory Bus: 8,192^* bit
Memory Bandwidth: 3.28 TB/s^*
Render Config TMUs: 832^*
Top GRAPHICS PROCESSOR: Aldebaran^*
Render Config ROPs: 0^*
Theoretical Performance Pixel Rate: 0 MPixel/s
Theoretical Performance Texture Rate: 1,414.4 GTexel/s
Board Design Slot Width: Dual-slot^*
Board Design TDP: 500^* W
Board Design Suggested PSU: 900^* W
Board Design Outputs: No outputs^*
Graphics Features OpenCL: 3^*
source file: amd2021.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: FirePro Data Center^*
Board Design Length: 267 mm 10.5 inches^*
Graphics Processor GPU Variant: Aldebaran^*
Board Design Power Connectors: 2x 8-pin^*
Graphics Processor Density: 80.4M / mm²^*
Board Design Height: 111 mm 4.4 inches^*
Top TMUS: 832^*
Clock Speeds Base Clock: 1,000^* MHz
Clock Speeds Boost Clock: 1,700^* MHz
Top CORES: 13,312^*
Render Config Shading Units: 13,312^*
Render Config Compute Units: 208^*
Render Config L2 Cache: 16^* MB
Top MEMORY SIZE: 128^* GB
Theoretical Performance FP32 (float): 45.26^* TFLOPS
Theoretical Performance FP64 (double): 45.26 TFLOPS (1:1)
Render Config L1 Cache: 16 KB (per CU)^*
Theoretical Performance FP16 (half): 362.1 TFLOPS (8:1)
Top MEMORY TYPE: HBM2e^*

Specifications 5 · 27 fields

manufacturer: AMD^*
manufacturer: AMD^*
rop: 0^*
rop: 96^*
igp: No^*
igp: No^*
bus: PCIe 4.0 x16^*
bus: PCIe 4.0 x16^*
memType: HBM2e^*
memType: GDDR6^*
gpuChip: Navi 21^*
gpuChip: Aldebaran^*
productName: Radeon Instinct MI250^*
productName: Radeon Instinct MI250^*
releaseYear: 2,021^*
releaseYear: 2,021^*
memSize: 128^*
memSize: 128^*
memBusWidth: 8,192^*
gpuClock: 1,000^*
gpuClock: 1,700^*
memClock: 1,600^*
memClock: 2,000^*
unifiedShader: 3,840^*
unifiedShader: 13,312^*
tmu: 832^*
tmu: 240^*

* Provisional data