Text Model
Can I Run Mistral Large 3 NVFP4 Locally?
FP4 quantized version for NVIDIA NIM
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Incompatible
VRAM Usage1604GB / 12GB
Est. Speed~0.0 T/s
Context (KV)
1165.30 GB
Disk Space
405.0 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.
Try These Instead
Compatible Text models that work with your hardware
Similar Models
Llama 4 Behemoth
2000BFlagship 2T foundation model, 16 experts
flagshipmeta
Mistral Large 3
675BGranular MoE flagship, 256K context
flagshipmistral
Ministral 3 14B
14BDense edge flagship with vision
edgemistral