AWS Trainium

Inferentia/Trainium Architecture

Active

Launched November 2021

Core Specifications

VendorAWS

ArchitectureInferentia/Trainium

Form Factor—

VRAM32 GB

Memory Bandwidth—

TDP200 W

Precision	TFLOPs
BF16	190

Configuration	Precision	Performance	Source
EC2 p5.48xlarge pricing (on-demand)	—	13.5 cost_per_hour	View
LLaMA 70B, BF16, optimized for AWS	—	4,200 tokens_per_second	View

Peak Performance

190

TFLOPs (BF16)

Efficiency

0.95

TFLOPs per Watt

View other AWS GPUs or compare across vendors