A100 40GB

Ampere2020400W TDPBF16
NVIDIA Product Page

Specifications

CUDA Cores6,912
Tensor Cores432
AI TOPS-
FP32 TFLOPS19.5
Memory40 GB HBM2e
Memory Bandwidth1,555 GB/s
Memory Interface5120-bit
TDP400W

Pricing

Proshop (cheapest)-
Vast.ai$0.63/hr
Google Cloud$3.67/hr

Efficiency

Power Efficiency
CUDA/Watt
17.28
Tensor/Watt
1.08
Bandwidth/Watt
3.89GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
10,971.43
GCP
1,883.38
Modal
3,291.43