LocalOps

Text Model

Can I Run Jamba 1.5 Large Locally?

Hybrid Transformer-Mamba, 256k context

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Incompatible
VRAM Usage946.4GB / 12GB
Est. Speed~0.0 T/s
Context (KV)
687.75 GB
Disk Space
238.8 GB
Your hardware does not meet the minimum memory requirements to run this model even with offloading.

Try These Instead

Compatible Text models that work with your hardware

6 Compatible Options

Similar Models

Jamba v0.1

52B

Mamba-Transformer Hybrid

hybridai21

Jamba 1.5 Mini

52B

Efficient hybrid architecture

hybridai21

Jamba Mini

12B

Mamba architecture, 256K context

efficientai21