Text Model
Can I Run Command R 7B Locally?
Efficient RAG specialist
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage17.7GB / 12GB
Est. Speed~42.4 T/s
Context (KV)
12.51 GB
Disk Space
4.2 GB
32% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Command R+ (104B)
104BEnterprise RAG and tool use
enterprisecohere
Command R (35B)
35BRetrieval-optimized
ragcohere
Aya Expanse 32B
32BMultilingual specialist
multilingualcohere