NVIDIA H200 SXM
Hopper Architecture
Active
Launched November 2023
Core Specifications
VendorNVIDIA
ArchitectureHopper
Form FactorSXM
VRAM141 GB
Memory Bandwidth4,800 GB/s
TDP700 W
Compute Performance
| Precision | TFLOPs |
|---|---|
| FP32 | 67 |
| FP16 | 1,979 |
| BF16 | 1,979 |
| FP8 | 3,958 |
Performance Benchmarks
image gen
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| Stable Diffusion XL, 1024x1024, 50 steps | — | 2.5 images_per_second | View |
llm inference
| Configuration | Precision | Performance | Source |
|---|---|---|---|
| LLaMA 70B, batch_size=1 | — | 8,000 tokens_per_second | View |
Pricing
Hardware Purchase (CAPEX)
| Type | Price (USD) | Region | As of |
|---|---|---|---|
| Street Price | $40,000 | global | Dec 2025 |