LocalOps

Text Model

Can I Run Solar Mini Locally?

Compact depth-upscaled

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage26.4GB / 12GB
Est. Speed~19.8 T/s
Context (KV)
18.94 GB
Disk Space
6.4 GB
55% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Llama 3.2 11B Vision

10.61B

Compact multimodal model

visionmeta

Qwen 2.5 7B

7.6B

Efficient general purpose

efficientalibaba

Mistral Nemo 12B

12B

Compact and capable

efficientmistral