Compare XPUs
Select up to 5 XPUs to compare side-by-side
Select XPUs to Compare
Alibaba
Hanguang 800
AMD
MI100
23.1 TFLOPs
AMD
MI210
181 TFLOPs
AMD
MI250X
383 TFLOPs
AMD
MI300A
980.6 TFLOPs
AMD
MI300X
1,307 TFLOPs
AMD
MI325X
1,400 TFLOPs
AMD
MI350X
2,100 TFLOPs
AMD
Radeon PRO W7900
122 TFLOPs
AMD
Radeon RX 7900 XT
104 TFLOPs
AMD
Radeon RX 7900 XTX
122 TFLOPs
AWS
Inferentia2
190 TFLOPs
AWS
Trainium
190 TFLOPs
AWS
Trainium2
680 TFLOPs
Baidu
Kunlun II
Biren Technology
BR100
Cambricon
MLU370
256 TFLOPs
Cerebras
WSE-3
Enflame Technology
CloudBlazer T20
Etched
Sohu
10,000 TFLOPs
FuriosaAI
Warboy
TPU v4
275 TFLOPs
TPU v5e
197 TFLOPs
TPU v5p
459 TFLOPs
TPU v6e (Trillium)
918 TFLOPs
Graphcore
Bow IPU
Graphcore
IPU-M2000
Groq
LPU Inference Engine
Huawei
Ascend 910B
Iluvatar CoreX
BI-V150
300 TFLOPs
Intel
Data Center GPU Max 1100
177 TFLOPs
Intel
Data Center GPU Max 1550
419 TFLOPs
Intel Habana
Gaudi 2
432 TFLOPs
Intel Habana
Gaudi 3
1,835 TFLOPs
Meta
MTIA v1
Microsoft
Maia 100
700 TFLOPs
Moore Threads
MTT S80
NVIDIA
A10
125 TFLOPs
NVIDIA
A100 SXM
312 TFLOPs
NVIDIA
A40
150 TFLOPs
NVIDIA
B200
2,250 TFLOPs
NVIDIA
GB200 NVL72
360,000 TFLOPs
NVIDIA
GB200 Superchip
5,000 TFLOPs
NVIDIA
GeForce RTX 4060 Ti
44.2 TFLOPs
NVIDIA
GeForce RTX 4070
58.2 TFLOPs
NVIDIA
GeForce RTX 4070 Super
71 TFLOPs
NVIDIA
GeForce RTX 4070 Ti
80.2 TFLOPs
NVIDIA
GeForce RTX 4070 Ti Super
88.2 TFLOPs
NVIDIA
GeForce RTX 4080
97.5 TFLOPs
NVIDIA
GeForce RTX 4080 Super
104.4 TFLOPs
NVIDIA
GeForce RTX 4090
165.2 TFLOPs
NVIDIA
GeForce RTX 5070
61.6 TFLOPs
NVIDIA
GeForce RTX 5070 Ti
88 TFLOPs
NVIDIA
GeForce RTX 5080
112.6 TFLOPs
NVIDIA
GeForce RTX 5090
209.5 TFLOPs
NVIDIA
H100 PCIe
1,513 TFLOPs
NVIDIA
H100 SXM
1,979 TFLOPs
NVIDIA
H200 PCIe
1,513 TFLOPs
NVIDIA
H200 SXM
1,979 TFLOPs
NVIDIA
L4
121 TFLOPs
NVIDIA
L40S
733 TFLOPs
NVIDIA
RTX 4000 Ada Generation
53.4 TFLOPs
NVIDIA
RTX 5000 Ada Generation
130.6 TFLOPs
NVIDIA
RTX 6000 Ada Generation
182.2 TFLOPs
NVIDIA
RTX PRO 6000 Blackwell Max-Q
125 TFLOPs
NVIDIA
RTX PRO 6000 Blackwell Server Edition
250 TFLOPs
NVIDIA
RTX PRO 6000 Blackwell Workstation Edition
250 TFLOPs
Qualcomm
Cloud AI 100
50 TFLOPs
Rebellions
ATOM
SambaNova
SN40L
Tenstorrent
Grayskull
200 TFLOPs
Tenstorrent
Wormhole
364 TFLOPs
Maximum of 5 XPUs can be compared at once. Deselect one to add another.
Multi-Metric Comparison
Relative performance across 5 key metrics (normalized to 100 = best in comparison)
Compute Performance (BF16)
Memory Capacity
Power Consumption
Power Efficiency
Specifications
| Specification | NVIDIA A40 | AMD MI250X | AWS Inferentia2 | NVIDIA H100 SXM | Etched Sohu |
|---|---|---|---|---|---|
| Architecture | Ampere | CDNA 2 | Inferentia Gen2 | Hopper | Transformer ASIC |
| Form Factor | PCIe | OAM | — | SXM | PCIe |
| VRAM | 48 GB | 128 GB | 32 GB | 80 GB | 144 GB |
| Memory Bandwidth | 696 GB/s | 3,277 GB/s | — | 3,350 GB/s | 4,800 GB/s |
| TFLOPs (FP32) | 37.4 | 47.9 | — | 67 | 10,000 |
| TFLOPs (FP16) | 150 | 383 | — | 1,979 | — |
| TFLOPs | 150 | 383 | 190 | 1,979 | 10,000 |
| TFLOPs (FP8) | — | — | — | 3,958 | — |
| TDP | 300 W | 560 W | 150 W | 700 W | 700 W |
| Launch Date | Oct 2020 | Nov 2021 | Nov 2022 | Sep 2022 | Jun 2024 |
Efficiency Metrics
| Metric | A40 | MI250X | Inferentia2 | H100 SXM | Sohu |
|---|---|---|---|---|---|
| TFLOPs per Watt (FP32-eq) | 0.25 | 0.34 | 0.63 | 1.41 | 14.29 |
| Memory Bandwidth per GB | 14.5 GB/s | 25.6 GB/s | — | 41.9 GB/s | 33.3 GB/s |
Performance Equivalence
How many units of each GPU are needed to match the performance of the others?
To match 1x NVIDIA A40
To match 1x AMD MI250X
To match 1x AWS Inferentia2
To match 1x NVIDIA H100 SXM
To match 1x Etched Sohu
Pricing
| Price Type | A40 | MI250X | Inferentia2 | H100 SXM | Sohu |
|---|---|---|---|---|---|
| CAPEX (Street Price) | — | $12,000 | — | $30,000 | — |
| OPEX (per hour) | — | $2.00/hr | — | $3.50/hr | — |
| Price per TFLOPs (FP32-eq) | — | $63 | — | $30 | — |