Best Mistral Models to Run Locally
Mistral AI's models are all Apache 2.0 licensed and range from the efficient 7B workhorse to the multilingual Nemo 12B and the Mixtral 8x7B mixture-of-experts.
Mistral 7B v0.3
Mistral AI · Apache 2.0
The model that proved 7B parameters can match much larger models on reasoning tasks when trained carefully. Apache 2.0 licensed, so it is fully free to use commercially with no restrictions.
Min VRAM
4 GB
Context
32K
Run with Ollama
ollama run mistral:7bMixtral 8x7B
Mistral AI · Apache 2.0
A sparse mixture-of-experts model that activates only 12B parameters per token while carrying 47B total, delivering 70B-class results at a fraction of the compute cost. One of the best open-weight models available under a fully permissive license.
Min VRAM
26 GB
Context
32K
Run with Ollama
ollama run mixtral:8x7bMistral Nemo 12B
Mistral AI · Apache 2.0
Built in partnership with NVIDIA and trained on a broad multilingual corpus, Nemo is Mistral's best model for non-English tasks across European and Asian languages. The 128K context window makes it practical for processing long documents locally.
Min VRAM
7 GB
Context
128K
Run with Ollama
ollama run mistral-nemo:12bWant to mix in more filters?
Open the faceted model browser to combine VRAM, family, license, developer and task filters, then sort the results your way.