Back to CalculatorTest on NVIDIA RTX 4090Open Simulator
NVIDIA RTX 4090
The NVIDIA RTX 4090 is a dedicated GPU featuring 24 GB of VRAM and a memory bandwidth of 1008 GB/s.
Hardware Specifications
VRAM24 GB
Bandwidth1008 GB/s
Generation40
TDP450 W
Build a system with NVIDIA RTX 4090?
Connect this GPU to our simulator to find out exactly how many tokens per second you'll get on top models.
Share this GPU
Similar GPUs
Related Guides
How much VRAM do you really need?
A complete breakdown of quantization levels and VRAM overhead for running local models.
Best GPUs for Machine Learning in 2026
Comparing NVIDIA and AMD options for the best speed-to-dollar ratio.
Multi-GPU Scaling
Can you stack multiple cheaper GPUs instead of buying one big one?