L40S

Ada Lovelace2023350W TDPBF16FP8
NVIDIA Product Page

Specifications

CUDA Cores18,176
Tensor Cores568
AI TOPS1,466
FP32 TFLOPS91.6
Memory48 GB GDDR6
Memory Bandwidth864 GB/s
Memory Interface384-bit
TDP350W

Pricing

Proshop (cheapest)-
Vast.ai-
Google Cloud-

Efficiency

Power Efficiency
CUDA/Watt
51.93
Tensor/Watt
1.62
Bandwidth/Watt
2.47GB/s/W
Rental Value (CUDA/$/hr)
Modal
9,321.03