LocalOps

Vision Model

Can I Run Molmo 72B Locally?

AllenAI open state-of-the-art

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Incompatible
VRAM Usage80GB / 12GB
Est. SpeedN/A (Non-Text)
Context (KV)
N/A
Disk Space
80 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.

Try These Instead

Compatible Vision models that work with your hardware

6 Compatible Options

Similar Models

Llama 4 Behemoth

2000B

Flagship 2T foundation model, 16 experts

flagshipmeta

Mistral Large 3

675B

Granular MoE flagship, 256K context

flagshipmistral

Mistral Large 3 NVFP4

675B

FP4 quantized version for NVIDIA NIM

flagshipmistral