Text Model
Can I Run Granite Code 8B Locally?
Code specialist from IBM
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage20.2GB / 12GB
Est. Speed~33.1 T/s
Context (KV)
14.44 GB
Disk Space
4.8 GB
41% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Qwen 2.5 72B
72.7BTop-tier reasoning and coding
codingalibaba
Qwen 2.5 Coder 32B
32.5BState-of-the-art code generation
codingalibaba
Qwen 2.5 Coder 14B
14.7BStrong coding in smaller package
codingalibaba