Can the NVIDIA RTX 6090 (Rubin) Run Local AI?
Detailed AI compatibility report for NVIDIA RTX 6090 (Rubin). Specifications, VRAM analysis, and model performance benchmarks.
VRAM
48GB
Bandwidth
2304 GB/s
Compatible Models
402
Runs with Offload
8
Top Compatible Models for NVIDIA RTX 6090 (Rubin)
Ministral 3 14B
~80.0 T/sUses 34.4GB VRAM
Ministral 3 8B
~120.0 T/sUses 20.2GB VRAM
Ministral 3 3B
~200.0 T/sUses 8.6GB VRAM
Llama 3.2 11B Vision
~120.0 T/sUses 26.2GB VRAM
Llama 3.2 3B
~200.0 T/sUses 8.9GB VRAM
Llama 3.2 1B
~200.0 T/sUses 3.9GB VRAM
Llama 3.1 8B
~120.0 T/sUses 20.3GB VRAM
Qwen 2.5 14B
~80.0 T/sUses 35.5GB VRAM
Qwen 2.5 7B
~120.0 T/sUses 19.6GB VRAM