Back to CalculatorDeploy Now
Functionary V3 Medium
MeetKai's agentic control model
Specifications
SourceArchitectureTEXT
Parameters70B
Familyfunctionary
VRAM (Q4)35.0G
Native structured output generation
agentmeetkai
Build your Local Rig
Ready to run locally? Shop top-tier GPUs on Amazon for the best performance.
Instant Cloud GPUs
Running out of VRAM? Rent a high-end H100 or RTX 4090 on RunPod and deploy in seconds.
Quantization Estimates
| Format | VRAM Need | Tier |
|---|---|---|
| FP16 | 140.0 GB | Full Precision |
| Q8_0 | 70.0 GB | High |
| Q6_K | 59.5 GB | Excellent |
| Q5_K_M | 49.0 GB | Great |
| Q4_K_M | 35.0 GB | Sweet Spot |
| Q2_K | 21.0 GB | Emergency |
Share this Model
Send these specs directly to your community.