Catalog/Gaudi 2

Intel Habana Gaudi 2

Gaudi Gen2 Architecture

Active

Launched May 2022

Core Specifications

VendorIntel Habana
ArchitectureGaudi Gen2
Form FactorOAM
VRAM96 GB
Memory Bandwidth2,450 GB/s
TDP600 W

Compute Performance

PrecisionTFLOPs
BF16432

Performance Benchmarks

llm train

ConfigurationPrecisionPerformanceSource
GPT-3 175B equivalent—1,800 hours_to_trainView
LLaMA 70B, BF16, batch_size=32—5,500 tokens_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 70B, BF16, batch_size=1—3,250 tokens_per_secondView

Quick Stats

Peak Performance
432
TFLOPs (BF16)
Efficiency
0.72
TFLOPs per Watt

Actions

Compare with OthersOfficial Specs

Similar XPUs

View other Intel Habana GPUs or compare across vendors

All Intel Habana XPUs →All OAM XPUs →