LocalOps

Text Model

Can I Run StarCoder2 15B Locally?

Code specialist

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage35.9GB / 12GB
Est. Speed~11.0 T/s
Context (KV)
25.90 GB
Disk Space
9.0 GB
67% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Qwen 2.5 72B

72.7B

Top-tier reasoning and coding

codingalibaba

Qwen 2.5 Coder 32B

32.5B

State-of-the-art code generation

codingalibaba

Qwen 2.5 Coder 14B

14.7B

Strong coding in smaller package

codingalibaba