LocalOps

Vision Model

Can I Run LLaVA 1.6 34B Locally?

State-of-the-art vision-language

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Incompatible
VRAM Usage40GB / 12GB
Est. SpeedN/A (Non-Text)
Context (KV)
N/A
Disk Space
40 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.

Try These Instead

Compatible Vision models that work with your hardware

6 Compatible Options

Similar Models

Ministral 3 14B

14B

Dense edge flagship with vision

edgemistral

Ministral 3 8B

8B

Balanced edge model with vision

edgemistral

Ministral 3 3B

3B

Lightweight mobile model with vision

mobilemistral