LocalOps LogoLocalOps
Back to Calculator

Devstral Small 2

Mistral AI's updated coding agent — 24B parameters, Apache 2.0, 256K context window with vision support. Mistral Vibe CLI included. Built on Ministral 3 architecture with Scalable-Softmax.

Specifications

Source
ArchitectureTEXT
Parameters24B
Familydevstral
VRAM (Q4)12.0G
Best used with OpenHands or Mistral Vibe CLI. Current llama.cpp/Ollama implementations may have reduced accuracy — vLLM strongly recommended.
mistralcodingagenticapache2swe-benchvision

Build your Local Rig

Ready to run locally? Shop top-tier GPUs on Amazon for the best performance.

Instant Cloud GPUs

Running out of VRAM? Rent a high-end H100 or RTX 4090 on RunPod and deploy in seconds.

Deploy Now

Quantization Estimates

FormatVRAM NeedTier
FP1648.0 GBFull Precision
Q8_024.0 GBHigh
Q6_K20.4 GBExcellent
Q5_K_M16.8 GBGreat
Q4_K_M12.0 GBSweet Spot
Q2_K7.2 GBEmergency

Share this Model

Send these specs directly to your community.

Post