AMD Instinct MI300X

Accelerators

Processing & platform

Architecture: CDNA 3^*

Memory & storage

Video memory: 192 GB^*
Video memory type: HBM3^*
Memory bus: 8,192 bit^*
Rated memory bandwidth: 5,300 GB/s^*

System configuration

Detailed specifications

Specifications 1 · 22 fields

GPU architecture — AMD Instinct MI300X — 192 GB HBM3: CDNA 3^*
Theoretical peak: BF16 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 1,307.4^* TFLOPS
Theoretical peak: FP16 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 1,307.4^* TFLOPS
Theoretical peak: FP32 non-tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 163.4^* TFLOPS
Native hardware support: FP4 tensor — AMD Instinct MI300X — 192 GB HBM3: No^*
Theoretical peak: FP64 non-tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 81.7^* TFLOPS
Theoretical peak: FP64 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 163.4^* TFLOPS
Native hardware support: FP6 tensor — AMD Instinct MI300X — 192 GB HBM3: No^*
Theoretical peak: FP8 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 2,614.9^* TFLOPS
Theoretical peak: INT8 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 2,614.9^* TOPS
Theoretical peak: TF32 tensor dense per GPU — AMD Instinct MI300X — 192 GB HBM3: 653.7^* TFLOPS
Physical configuration — AMD Instinct MI300X — 192 GB HBM3: OAM^*
GPU interconnect bandwidth (Infinity Fabric) bidirectional — AMD Instinct MI300X — 192 GB HBM3: 896^* GB/s
GPU interconnect bandwidth per direction — AMD Instinct MI300X — 192 GB HBM3: 448^* GB/s
Infinity Fabric link count — AMD Instinct MI300X — 192 GB HBM3: 7^* links
PCIe interface declaration — AMD Instinct MI300X — 192 GB HBM3: PCIe Gen 5 x16^*
Maximum board power — AMD Instinct MI300X — 192 GB HBM3: 750^* W
Peak memory bandwidth per GPU — AMD Instinct MI300X — 192 GB HBM3: 5,300^* GB/s
Memory interface width per GPU — AMD Instinct MI300X — 192 GB HBM3: 8,192^* bit
Memory capacity per GPU — AMD Instinct MI300X — 192 GB HBM3: 192^* GB
Memory technology — AMD Instinct MI300X — 192 GB HBM3: HBM3^*
GPU model — AMD Instinct MI300X — 192 GB HBM3: AMD Instinct MI300X^*

Specifications 2 · 15 fields

device name: AMD Instinct MI300X^*
typical power w: 750^* W
hbm memory gb: 192^* GB
memory bandwidth tb s: 5.3^*
headline metric: 2614.9 TOPS INT8 dense (5229.8 sparse); 192 GB HBM3, the largest on-package memory of the GPU baselines^*
source type: Vendor^*
vendor: AMD^*
tops per watt calc: 3.487^*
compute paradigm: Electronic^*
device type: GPU^*
release year: 2023^*
maturity: Commercial^*
precision: INT8/FP8^*
throughput unit: TOPS^*
peak throughput: 2,614.9^*

* Provisional data