Text Model
Can I Run Phi-3 Small (7B) Locally?
Efficient general purpose
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage18.3GB / 12GB
Est. Speed~39.0 T/s
Context (KV)
12.85 GB
Disk Space
4.4 GB
34% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Llama 3.2 11B Vision
10.61BCompact multimodal model
visionmeta
Qwen 2.5 7B
7.6BEfficient general purpose
efficientalibaba
Mistral Nemo 12B
12BCompact and capable
efficientmistral