LocalOps

Embedding Model

Can I Run NV-Embed-v2 Locally?

Top MTEB leaderboard performer

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Ready to Run
VRAM Usage5.2GB / 12GB
Est. SpeedN/A (Non-Text)
Context (KV)
N/A
Disk Space
4.2 GB

Similar Models

Llama 4 Behemoth

2000B

Flagship 2T foundation model, 16 experts

flagshipmeta

Mistral Large 3

675B

Granular MoE flagship, 256K context

flagshipmistral

Mistral Large 3 NVFP4

675B

FP4 quantized version for NVIDIA NIM

flagshipmistral