LocalOps

Text Model

Can I Run Dolphin 2.9 Llama 3 Locally?

Popular uncensored fine-tune

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage20.2GB / 12GB
Est. Speed~33.1 T/s
Context (KV)
14.44 GB
Disk Space
4.8 GB
41% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Llama 4 Maverick

400B

High-efficiency MoE, 128 experts, 1M context

chatmeta

Llama 4 Scout

109B

Consumer flagship MoE, 16 experts, 10M context

chatmeta

Grok-3 Mini

45B

Efficient reasoning model with real-time tools

chatxai