Intel Habana Gaudi 2

Gaudi Gen2 Architecture

Active

Launched May 2022

Core Specifications

VendorIntel Habana
ArchitectureGaudi Gen2
Form FactorOAM
VRAM96 GB
Memory Bandwidth2,450 GB/s
TDP600 W

Compute Performance

PrecisionTFLOPs
BF16432

Performance Benchmarks

llm train

ConfigurationPrecisionPerformanceSource
GPT-3 175B equivalent1,800 hours_to_trainView
LLaMA 70B, BF16, batch_size=325,500 tokens_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 70B, BF16, batch_size=13,250 tokens_per_secondView

Quick Stats

Peak Performance
432
TFLOPs (BF16)
Efficiency
0.72
TFLOPs per Watt

Similar XPUs

View other Intel Habana GPUs or compare across vendors