RTX 3090

Ampere2020350W TDPBF16
NVIDIA Product Page

Specifications

CUDA Cores10,496
Tensor Cores328
AI TOPS285
FP32 TFLOPS36.0
Memory24 GB GDDR6X
Memory Bandwidth936 GB/s
Memory Interface384-bit
TDP350W

Pricing

Proshop (cheapest)-
Vast.ai$0.11/hr
Google Cloud-
Modal-

Efficiency

Power Efficiency
CUDA/Watt
29.99
Tensor/Watt
0.94
Bandwidth/Watt
2.67GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
95,418.18