Text Model
Can I Run Granite 3.0 8B Locally?
IBM enterprise-grade robust model
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage20.4GB / 12GB
Est. Speed~32.4 T/s
Context (KV)
14.53 GB
Disk Space
4.9 GB
41% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Llama 3.1 70B
70.55BEnterprise-grade intelligence
chatmeta
Mistral Small (24B)
24BEfficient enterprise model
enterprisemistral
Command R+ (104B)
104BEnterprise RAG and tool use
enterprisecohere