LocalOps

Text Model

Can I Run Aya 23 35B Locally?

Cohere's massive multilingual model

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Incompatible
VRAM Usage83.2GB / 12GB
Est. Speed~0.0 T/s
Context (KV)
60.42 GB
Disk Space
21.0 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.

Try These Instead

Compatible Text models that work with your hardware

6 Compatible Options

Similar Models

Command R+ (104B)

104B

Enterprise RAG and tool use

enterprisecohere

Command R (35B)

35B

Retrieval-optimized

ragcohere

Aya Expanse 32B

32B

Multilingual specialist

multilingualcohere