A100 80GB

Ampere2020400W TDPBF16
NVIDIA Product Page

Specifications

CUDA Cores6,912
Tensor Cores432
AI TOPS-
FP32 TFLOPS19.5
Memory80 GB HBM2e
Memory Bandwidth2,039 GB/s
Memory Interface5120-bit
TDP400W

Pricing

Proshop (cheapest)-
Vast.ai$1.20/hr
Google Cloud$5.12/hr

Efficiency

Power Efficiency
CUDA/Watt
17.28
Tensor/Watt
1.08
Bandwidth/Watt
5.10GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
5,760.00
GCP
1,350.00
Modal
2,764.80