NVIDIA L4

Ada Lovelace Architecture

Active

Launched March 2023

Core Specifications

VendorNVIDIA
ArchitectureAda Lovelace
Form FactorPCIe
VRAM24 GB
Memory Bandwidth300 GB/s
TDP72 W

Compute Performance

PrecisionTFLOPs
FP3230.3
FP16242
BF16121
FP8485

Performance Benchmarks

image gen

ConfigurationPrecisionPerformanceSource
Stable Diffusion XL, 1024x1024, 50 steps0.63 images_per_secondView

llm inference

ConfigurationPrecisionPerformanceSource
LLaMA 13B, first token latency42.857 latency_msView
LLaMA 13B, batch_size=11,400 tokens_per_secondView

Pricing

Hardware Purchase (CAPEX)

TypePrice (USD)RegionAs of
Street Price$4,000globalDec 2025

Cloud Rental (OPEX)

ProviderInstance TypePrice per HourRegionAs of
Google Cloud$0.80/hrus-eastDec 2025

Quick Stats

Peak Performance
121
TFLOPs (BF16)
Efficiency
1.68
TFLOPs per Watt
Price per TFLOPs
$33
USD per TFLOPs (BF16)

Similar XPUs

View other NVIDIA GPUs or compare across vendors