NVIDIA L40S

Ada Lovelace Architecture

Active

Launched October 2023

Core Specifications

VendorNVIDIA
ArchitectureAda Lovelace
Form FactorPCIe
VRAM48 GB
Memory Bandwidth864 GB/s
TDP350 W

Compute Performance

PrecisionTFLOPs
FP3291.6
FP16733
BF16733
FP81,466

Performance Benchmarks

image gen

ConfigurationPrecisionPerformanceSource
Stable Diffusion XL, 1024x1024, 50 steps1.8 images_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 13B, first token latency15 latency_msView
LLaMA 13B, batch_size=14,000 tokens_per_secondView

Pricing

Hardware Purchase (CAPEX)

TypePrice (USD)RegionAs of
Street Price$10,000globalDec 2025

Cloud Rental (OPEX)

ProviderInstance TypePrice per HourRegionAs of
AWS$1.50/hrus-eastDec 2025

Quick Stats

Peak Performance
733
TFLOPs (BF16)
Efficiency
2.09
TFLOPs per Watt
Price per TFLOPs
$14
USD per TFLOPs (BF16)

Similar XPUs

View other NVIDIA GPUs or compare across vendors