SambaNova SN40L

Reconfigurable Dataflow Unit (RDU) Architecture

Active

Launched January 2024

Core Specifications

VendorSambaNova

ArchitectureReconfigurable Dataflow Unit (RDU)

Form Factor—

VRAM640 GB

Memory Bandwidth—

TDP700 W

Precision	TFLOPs

Configuration	Precision	Performance	Source
LLaMA 70B, batch inference	—	7,200 tokens_per_second	View

Configuration	Precision	Performance	Source
GPT-3 scale, reconfigurable dataflow	—	10,500 tokens_per_second	View

View other SambaNova GPUs or compare across vendors