LocalOps

Text Model

Can I Run Phi-3 Medium (14B) Locally?

Balanced Phi model

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage34.4GB / 12GB
Est. Speed~12.2 T/s
Context (KV)
25.02 GB
Disk Space
8.4 GB
65% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Qwen 2.5 32B

32.5B

The "Goldilocks" model - great balance

balancedalibaba

Qwen 2.5 14B

14.7B

Strong mid-size model

balancedalibaba

Qwen 3 30B (MoE)

30B

Punching way above its weight class

balancedalibaba