NVIDIA H200 SXM

Hopper Architecture

Active

Launched November 2023

Core Specifications

VendorNVIDIA
ArchitectureHopper
Form FactorSXM
VRAM141 GB
Memory Bandwidth4,800 GB/s
TDP700 W

Compute Performance

PrecisionTFLOPs
FP3267
FP161,979
BF161,979
FP83,958

Performance Benchmarks

image gen

ConfigurationPrecisionPerformanceSource
Stable Diffusion XL, 1024x1024, 50 steps2.5 images_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 70B, batch_size=18,000 tokens_per_secondView

llm train

ConfigurationPrecisionPerformanceSource
GPT-3 175B equivalent, multi-node720 hours_to_trainView
LLaMA 70B, batch_size=32BF1615,000 tokens_per_secondView

Pricing

Hardware Purchase (CAPEX)

TypePrice (USD)RegionAs of
Street Price$40,000globalDec 2025

Quick Stats

Peak Performance
1,979
TFLOPs (BF16)
Efficiency
2.83
TFLOPs per Watt
Price per TFLOPs
$20
USD per TFLOPs (BF16)

Similar XPUs

View other NVIDIA GPUs or compare across vendors