H100 80GB SXM5

Hopper2022700W TDPBF16FP8
NVIDIA Product Page

Specifications

CUDA Cores16,896
Tensor Cores528
AI TOPS-
FP32 TFLOPS66.9
Memory80 GB HBM3
Memory Bandwidth3,352 GB/s
Memory Interface5120-bit
TDP700W

Pricing

Proshop (cheapest)-
Vast.ai$1.44/hr
Google Cloud-

Efficiency

Power Efficiency
CUDA/Watt
24.14
Tensor/Watt
0.75
Bandwidth/Watt
4.79GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
11,733.33
Modal
4,277.47