RTX 4090

Ada Lovelace2022450W TDPBF16FP8
NVIDIA Product Page

Specifications

CUDA Cores16,384
Tensor Cores512
AI TOPS1,321
FP32 TFLOPS83.0
Memory24 GB GDDR6X
Memory Bandwidth1,008 GB/s
Memory Interface384-bit
TDP450W

Pricing

Proshop (cheapest)-
Vast.ai$0.27/hr
Google Cloud-
Modal-

Efficiency

Power Efficiency
CUDA/Watt
36.41
Tensor/Watt
1.14
Bandwidth/Watt
2.24GB/s/W
Rental Value (CUDA/$/hr)
Vast.ai
60,681.48