A100 40GB
Ampere2020400W TDPBF16
Specifications
CUDA Cores6,912
Tensor Cores432
AI TOPS-
FP32 TFLOPS19.5
Memory40 GB HBM2e
Memory Bandwidth1,555 GB/s
Memory Interface5120-bit
TDP400W
Efficiency
Power Efficiency
CUDA/Watt
17.28
Tensor/Watt
1.08
Bandwidth/Watt
3.89GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
10,971.43
GCP
1,883.38
Modal
3,291.43