Text Model
Can I Run OASST Pythia 12B Locally?
Open Assistant model
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage29.3GB / 12GB
Est. Speed~16.2 T/s
Context (KV)
21.14 GB
Disk Space
7.2 GB
59% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Llama 4 Maverick
400BHigh-efficiency MoE, 128 experts, 1M context
chatmeta
Llama 4 Scout
109BConsumer flagship MoE, 16 experts, 10M context
chatmeta
Grok-3 Mini
45BEfficient reasoning model with real-time tools
chatxai