LocalOps

Donate
Embedding Model

Can I Run SFR Embedding Mistral Locally?

Mistral-based embeddings

System Configuration

Configure your hardware to check compatibility

VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated

Compatibility Result

Based on your selected hardware

Runs with Offload
VRAM Usage16GB / 12GB
Est. SpeedN/A (Non-Text)
Context (KV)
N/A
Disk Space
16 GB
25% of layers will be offloaded to system RAM. This will significantly reduce generation speed.

Similar Models

Arctic Embed L v2

0.568B

Multilingual embedding model, 8K context

embeddingsnowflake

AudioLDM 2 Large

1.5B

High-quality audio gen

audiogeneration

BGE Large EN

0.335B

English embeddings

embeddingenglish
Buy Me A Coffee
Buy Me A Coffee