Text Model

Can I Run StarCoder2 15B Locally?

Code specialist

System Configuration

Configure your hardware to check compatibility

Graphics Card

System RAM

VRAM12GB

Bandwidth504 GB/s

TDP285W

System RAM32GB

Typededicated

Based on your selected hardware

Runs with Offload

VRAM Usage35.9GB / 12GB

Est. Speed~11.0 T/s

Context (KV)

25.90 GB

Disk Space

9.0 GB

67% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

33B

Self-correcting coding agent

codingagent

Multilingual code generation

codingthudm

8.54B

Code-focused Gemma

codinggoogle