LocalOps

Check Another GPU

Can the NVIDIA L40S Run Local AI?

Detailed AI compatibility report for NVIDIA L40S. Specifications, VRAM analysis, and model performance benchmarks.

VRAM
48GB
Bandwidth
864 GB/s
Compatible Models
402
Runs with Offload
8

Top Compatible Models for NVIDIA L40S

Ministral 3 14B

~66.9 T/s

Uses 34.4GB VRAM

Ministral 3 8B

~117.0 T/s

Uses 20.2GB VRAM

Ministral 3 3B

~200.0 T/s

Uses 8.6GB VRAM

Llama 3.2 11B Vision

~88.2 T/s

Uses 26.2GB VRAM

Llama 3.2 3B

~200.0 T/s

Uses 8.9GB VRAM

Llama 3.2 1B

~200.0 T/s

Uses 3.9GB VRAM

Llama 3.1 8B

~116.6 T/s

Uses 20.3GB VRAM

Qwen 2.5 14B

~63.7 T/s

Uses 35.5GB VRAM

Qwen 2.5 7B

~120.0 T/s

Uses 19.6GB VRAM

Check All 492 Models on Hardware Builder