Can the NVIDIA RTX 3090 Ti Run Local AI?
Detailed AI compatibility report for NVIDIA RTX 3090 Ti. Specifications, VRAM analysis, and model performance benchmarks.
VRAM
24GB
Bandwidth
1008 GB/s
Compatible Models
377
Runs with Offload
48
Top Compatible Models for NVIDIA RTX 3090 Ti
Ministral 3 8B
~120.0 T/sUses 20.2GB VRAM
Ministral 3 3B
~200.0 T/sUses 8.6GB VRAM
Llama 3.2 3B
~200.0 T/sUses 8.9GB VRAM
Llama 3.2 1B
~200.0 T/sUses 3.9GB VRAM
Llama 3.1 8B
~120.0 T/sUses 20.3GB VRAM
Qwen 2.5 7B
~120.0 T/sUses 19.6GB VRAM
Qwen 2.5 3B
~200.0 T/sUses 8.7GB VRAM
Qwen 2.5 1.5B
~200.0 T/sUses 5.3GB VRAM
Qwen 2.5 0.5B
~200.0 T/sUses 2.6GB VRAM
