NVIDIA A10

Ampere Architecture

Active

Launched April 2021

Core Specifications

VendorNVIDIA
ArchitectureAmpere
Form FactorPCIe
VRAM24 GB
Memory Bandwidth600 GB/s
TDP150 W

Compute Performance

PrecisionTFLOPs
FP3231.2
FP16125
BF16125

Performance Benchmarks

image gen

ConfigurationPrecisionPerformanceSource
Stable Diffusion 1.5, 512x512FP161 images_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 7B, edge inferenceFP162,800 tokens_per_secondView

Quick Stats

Peak Performance
125
TFLOPs (BF16)
Efficiency
0.83
TFLOPs per Watt

Similar XPUs

View other NVIDIA GPUs or compare across vendors