Intel Habana Gaudi 3

Gaudi Gen3 Architecture

Active

Launched April 2024

Core Specifications

VendorIntel Habana
ArchitectureGaudi Gen3
Form FactorOAM
VRAM128 GB
Memory Bandwidth3,700 GB/s
TDP900 W

Compute Performance

PrecisionTFLOPs
BF161,835
FP83,670

Performance Benchmarks

llm train

ConfigurationPrecisionPerformanceSource
GPT-3 175B equivalent900 hours_to_trainView
LLaMA 70B, BF16, batch_size=3211,000 tokens_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 70B, BF16, batch_size=16,500 tokens_per_secondView

Pricing

Hardware Purchase (CAPEX)

TypePrice (USD)RegionAs of
Street Price$15,000globalDec 2025

Cloud Rental (OPEX)

ProviderInstance TypePrice per HourRegionAs of
AWS$1.20/hrus-eastDec 2025

Quick Stats

Peak Performance
1,835
TFLOPs (BF16)
Efficiency
2.04
TFLOPs per Watt
Price per TFLOPs
$8
USD per TFLOPs (BF16)

Similar XPUs

View other Intel Habana GPUs or compare across vendors