LocalOps

Text Model

Can I Run Gorilla OpenFunctions v2 Locally?

DeepSeek-based API calling specialist

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage17.7GB / 12GB
Est. Speed~42.4 T/s
Context (KV)
12.51 GB
Disk Space
4.2 GB
32% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Qwen 3 8B

8.1B

Universal edge model, MCP native

edgealibaba

xLAM 8x22B

141B

Salesforce "Large Action Model" flagship

agentsalesforce

xLAM 7B FC

7B

Optimized for efficient function calling

agentsalesforce