Text Model
Can I Run Mixtral 8x7B (MoE) Locally?
Popular efficient MoE
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Incompatible
VRAM Usage111.7GB / 12GB
Est. Speed~0.0 T/s
Context (KV)
81.31 GB
Disk Space
28.0 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.
Try These Instead
Compatible Text models that work with your hardware
Similar Models
Llama 4 Scout
109BConsumer flagship MoE, 16 experts, 10M context
chatmeta
Mistral Large 3
675BGranular MoE flagship, 256K context
flagshipmistral
Mistral Large 3 NVFP4
675BFP4 quantized version for NVIDIA NIM
flagshipmistral