GeekRadar / The comparison desk

COMPARE.

GPU

AMD

Radeon Instinct MI300A

Graphics processor

Video memory: Reported value 1: 128 GB^*
Reported value 2: 192 GB^*
Reported value 3: 128 GB^*
Memory bus: 8,192 bit^*
Rated memory bandwidth: 5,320 GB/s^*

No matched benchmark results are available for this entry yet.

Processing & platform

Architecture: CDNA 3.0^*
Process node: 5 nm^*
GPU cores: 14,592^*
GPU base clock: 1,000 MHz^*
Graphics interface: PCIe 5.0 x16^*
Reported chip die area: 1,017 mm²^*
Transistors: 153,000 million^*
GPU boost clock: 2,100 MHz^*
GPU L2 cache: 16 MB^*
Graphics processor: Aqua^*
Texture mapping units: 912^*
Raster output units: 0^*
Chip foundry: TSMC^*
Card or module format: OAM Module^*
Declared GPU TDP: 750 W^*
Suggested system PSU: 1,150 W^*
External power connectors: None^*
OpenCL: 3.0^*

Memory & storage

Memory options: 192^*
Video memory: Reported value 1: 128 GB^*
Reported value 2: 192 GB^*
Reported value 3: 128 GB^*
Video memory type: HBM3^*
Memory bus: 8,192 bit^*
Rated memory bandwidth: 5,320 GB/s^*

Power specifications

Thermal design power: 750 W^*

System configuration

Detailed specifications

Specifications 1 · 22 fields

GPU architecture — AMD Instinct MI300A — 128 GB HBM3: CDNA 3^*
Theoretical peak: BF16 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 980.6^* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 980.6^* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 122.6^* TFLOPS
Native hardware support: FP4 tensor — AMD Instinct MI300A — 128 GB HBM3: No^*
Theoretical peak: FP64 non-tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 61.3^* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 122.6^* TFLOPS
Native hardware support: FP6 tensor — AMD Instinct MI300A — 128 GB HBM3: No^*
Theoretical peak: FP8 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 1,961.2^* TFLOPS
Theoretical peak: INT8 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 1,961.2^* TOPS
Theoretical peak: TF32 tensor dense per GPU — AMD Instinct MI300A — 128 GB HBM3: 490.3^* TFLOPS
Physical configuration — AMD Instinct MI300A — 128 GB HBM3: APU SH5 socket^*
GPU interconnect bandwidth (Infinity Fabric) bidirectional — AMD Instinct MI300A — 128 GB HBM3: 1,000^* GB/s
GPU interconnect bandwidth per direction — AMD Instinct MI300A — 128 GB HBM3: 500^* GB/s
Infinity Fabric link count — AMD Instinct MI300A — 128 GB HBM3: 8^* links
PCIe interface declaration — AMD Instinct MI300A — 128 GB HBM3: PCIe Gen 5 x16^*
Maximum whole-APU socket power — AMD Instinct MI300A — 128 GB HBM3: 760^* W
Peak shared CPU/GPU memory bandwidth — AMD Instinct MI300A — 128 GB HBM3: 5,300^* GB/s
Memory interface width per GPU — AMD Instinct MI300A — 128 GB HBM3: 8,192^* bit
Unified memory shared by CPU and GPU — AMD Instinct MI300A — 128 GB HBM3: 128^* GB
Memory technology — AMD Instinct MI300A — 128 GB HBM3: HBM3^*
GPU model — AMD Instinct MI300A — 128 GB HBM3: AMD Instinct MI300A^*

Specifications 2 · 26 fields

proc transistors: 153,000 million^*
proc die size: 1,017^* mm²
cores: 19,456^*
base clock: 1,000^*
boost clock: 2,100^*
memory clock: 2,525^*
ram: 192^*
name: AMD Radeon Instinct MI300A^*
ram type: HBM3^*
bus width: 8,192^*
bus interface: PCIe 5.0 x16^*
ram bandwidth: 10.3 TB/s^*
fp16 performance: 653.7^*
fp32 performance: 81.72^*
fp64 performance: 81.72^*
tdp: 750^* W
suggested psu: 1,150^* W
slot width: OAM Module^*
is retail board: No^*
gpi value: 94.1^*
vendor: amd^*
manufacturer: AMD^*
arch name: CDNA 3.0^*
card release date: 2023-12-06^*
proc foundry: TSMC^*
proc process size: 5^* nm

Specifications 3 · 30 fields

OpenCL

3.0^*

Graphics interface

PCIe 5.0 x16^*

Memory bus

8,192^* bit

Reported shader processors

14,592^*

Reported theoretical FP32 peak

61.29^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Reported theoretical FP64 peak

30.64^* TFLOPS

Scope and conditions

Arithmetic density: Not stated^*

Declared L1 cache configuration

16 KB (per CU)^*

Declared GPU L2 cache

16 MB^*

Reported display outputs

No outputs^*

Theoretical pixel fill rate

0 MPixel/s^*

External power connectors

None^*

Reported chip die area

1017 mm²^*

Chip foundry

TSMC^*

Process node declaration

5 nm^*

Transistors

153,000 million^*

Graphics processor

Aqua^*

Reported video memory

128^* GB

Rated memory bandwidth

5.32 TB/s^*

Video memory type

HBM3^*

Raster output units

0^*

Reported shading units

14,592^*

Card or module format

OAM Module^*

Suggested system PSU

1150 W^*

2:4 tensor sparsity

No^*

Declared GPU TDP

750 W^*

Theoretical texture fill rate

1,915.2 GTexel/s^*

Texture mapping units

912^*

GPU cores

14,592^*

Video memory

128^* GB

Video memory type

HBM3^*

Specifications 4 · 47 fields

Brand: AMD^*
Top BUS WIDTH: 8,192^* bit
Render Config MCM: 2^*
Graphics Processor GPU Name: Aqua Vanjaram^*
Render Config Matrix Cores: 1,216^*
Graphics Processor Architecture: CDNA 3.0^*
Graphics Processor Process Size: 5^* nm
Graphics Processor Transistors: 153,000 million^*
Graphics Processor Die Size: 1,017^* mm²
Graphics Card Release Date: Dec 6th, 2023^*
Graphics Card Generation: Radeon Instinct (MIx)^*
Name: Radeon Instinct MI300A^*
Graphics Card Bus Interface: PCIe 5.0 x16^*
Clock Speeds Memory Clock: 2525 MHz 10.1 Gbps effective^*
Memory Memory Size: 192^* GB
Memory Memory Type: HBM3^*
Memory Memory Bus: 8,192^* bit
Memory Bandwidth: 10.3 TB/s^*
Render Config TMUs: 1,216^*
Top GRAPHICS PROCESSOR: Aqua Vanjaram^*
Render Config ROPs: 0^*
Theoretical Performance Pixel Rate: 0 MPixel/s
Theoretical Performance Texture Rate: 2,553.6 GTexel/s
Board Design Slot Width: OAM Module^*
Board Design TDP: 750^* W
Board Design Suggested PSU: 1,150^* W
Board Design Outputs: No outputs^*
Graphics Features OpenCL: 3^*
source file: amd2023.json^*
Graphics Processor Foundry: TSMC^*
Graphics Card Predecessor: FirePro Data Center^*
Graphics Processor Density: 150.4M / mm²^*
Top TMUS: 1,216^*
Graphics Processor Chip Package: MCM^*
Clock Speeds Base Clock: 1,000^* MHz
Clock Speeds Boost Clock: 2,100^* MHz
Top CORES: 19,456^*
Render Config Shading Units: 19,456^*
Render Config Compute Units: 304^*
Render Config L2 Cache: 16^* MB
Top MEMORY SIZE: 192^* GB
Theoretical Performance FP32 (float): 81.72^* TFLOPS
Theoretical Performance FP64 (double): 81.72 TFLOPS (1:1)
Render Config L1 Cache: 16 KB (per CU)^*
Theoretical Performance FP16 (half): 653.7 TFLOPS (8:1)
Top MEMORY TYPE: HBM3^*
Render Config L3 Cache: 256^* MB

* Provisional data