Text Model

Can I Run StarCoder2 7B Locally?

Efficient code model

System Configuration

Configure your hardware to check compatibility

Graphics Card

System RAM

VRAM12GB

Bandwidth504 GB/s

TDP285W

System RAM32GB

Typededicated

Based on your selected hardware

Runs with Offload

VRAM Usage17.7GB / 12GB

Est. Speed~42.4 T/s

Context (KV)

12.51 GB

Disk Space

4.2 GB

32% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

33B

Self-correcting coding agent

codingagent

Multilingual code generation

codingthudm

8.54B

Code-focused Gemma

codinggoogle