LocalOps

Text Model

Can I Run Granite 3.0 3B Locally?

Small enterprise model

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Ready to Run
VRAM Usage8.6GB / 12GB
Est. Speed~182.0 T/s
Context (KV)
5.79 GB
Disk Space
1.8 GB

Similar Models

Llama 3.1 70B

70.55B

Enterprise-grade intelligence

chatmeta

Mistral Small (24B)

24B

Efficient enterprise model

enterprisemistral

Command R+ (104B)

104B

Enterprise RAG and tool use

enterprisecohere