Text Model
Can I Run Baichuan2 13B Locally?
Open Chinese foundation model
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage31.9GB / 12GB
Est. Speed~14.0 T/s
Context (KV)
23.08 GB
Disk Space
7.8 GB
62% of layers will be offloaded to system RAM. This will significantly reduce generation speed.
Similar Models
Yi 1.5 34B
34.4BStrong bilingual model
bilingual01ai
Yi 1.5 9B
8.8BEfficient bilingual
bilingual01ai
InternLM 2.5 20B
19.8BStrong Chinese/English
bilingualshanghai-ai