Can the NVIDIA L40 Run Local AI?
Detailed AI compatibility report for NVIDIA L40. Specifications, VRAM analysis, and model performance benchmarks.
VRAM
48GB
Bandwidth
864 GB/s
Compatible Models
402
Runs with Offload
8
Top Compatible Models for NVIDIA L40
Ministral 3 14B
~66.9 T/sUses 34.4GB VRAM
Ministral 3 8B
~117.0 T/sUses 20.2GB VRAM
Ministral 3 3B
~200.0 T/sUses 8.6GB VRAM
Llama 3.2 11B Vision
~88.2 T/sUses 26.2GB VRAM
Llama 3.2 3B
~200.0 T/sUses 8.9GB VRAM
Llama 3.2 1B
~200.0 T/sUses 3.9GB VRAM
Llama 3.1 8B
~116.6 T/sUses 20.3GB VRAM
Qwen 2.5 14B
~63.7 T/sUses 35.5GB VRAM
Qwen 2.5 7B
~120.0 T/sUses 19.6GB VRAM