AWS Trainium2

Trainium Gen2 Architecture

Active

Launched November 2023

Core Specifications

VendorAWS

ArchitectureTrainium Gen2

Form Factor—

VRAM—

Memory Bandwidth—

TDP300 W

Precision	TFLOPs
BF16	680

Configuration	Precision	Performance	Source
EC2 p5.48xlarge pricing (on-demand)	—	21.5 cost_per_hour	View
LLaMA 70B, BF16, optimized for AWS	—	12,000 tokens_per_second	View

Provider	Instance Type	Price per Hour	Region	As of
AWS	—	$1.34/hr	us-east-1	Dec 2025

Peak Performance

680

TFLOPs (BF16)

Efficiency

2.27

TFLOPs per Watt

View other AWS GPUs or compare across vendors