AMD MI300X
CDNA 3 Architecture
Active
Launched December 2023
Core Specifications
VendorAMD
ArchitectureCDNA 3
Form FactorOAM
VRAM192 GB
Memory Bandwidth5,300 GB/s
TDP750 W
Compute Performance
| Precision | TFLOPs |
|---|---|
| FP32 | 163 |
| FP16 | 1,307 |
| BF16 | 1,307 |
| FP8 | 2,614 |
Performance Benchmarks
image gen
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| Stable Diffusion XL, 1024x1024, 50 steps | — | 1.98 images_per_second | View |
llm inference
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| LLaMA 70B, batch_size=1 | — | 6,300 tokens_per_second | View |
llm train
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| LLaMA 70B, batch_size=32 | — | 11,700 tokens_per_second | View |
Pricing
Hardware Purchase (CAPEX)
| Type | Price (USD) | Region | As of |
|---|---|---|---|
| Street Price | $15,000 | Global | Oct 2024 |
| Street Price | $35,000 | global | Dec 2025 |
Cloud Rental (OPEX)
| Provider | Instance Type | Price per Hour | Region | As of |
|---|---|---|---|---|
| Hot Aisle | 1x MI300X (192GB) | $1.99/hr | Michigan | Oct 2024 |
| Lambda Labs | 1x MI300X | $3.99/hr | us-west-2 | Oct 2024 |
| Azure | Standard_ND96isr_MI300X_v5 (1x MI300X) | $10.40/hr | East US | Oct 2024 |