LocalOps

Text Model

Can I Run Yi 1.5 9B Locally?

Efficient bilingual

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage22.5GB / 12GB
Est. Speed~27.4 T/s
Context (KV)
16.19 GB
Disk Space
5.3 GB
47% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Yi 1.5 34B

34.4B

Strong bilingual model

bilingual01ai

Yi Coder 9B

8.8B

Code specialist

coding01ai

InternLM 2.5 20B

19.8B

Strong Chinese/English

bilingualshanghai-ai