AMD MI350X
CDNA 4 Architecture
Active
Launched June 2025
Core Specifications
VendorAMD
ArchitectureCDNA 4
Form FactorOAM
VRAM288 GB
Memory Bandwidth—
TDP850 W
Compute Performance
| Precision | TFLOPs |
|---|---|
| BF16 | 2,100 |
Performance Benchmarks
image gen
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| Stable Diffusion XL, 1024x1024, 50 steps | — | 2.53 images_per_second | View |
llm inference
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| LLaMA 70B, batch_size=1 | — | 8,050 tokens_per_second | View |
llm train
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| LLaMA 70B, batch_size=32 | — | 14,950 tokens_per_second | View |