Mixtral 8x7B
Mistral AI · Mistral
A sparse mixture-of-experts model that activates only 12B parameters per token while carrying 47B total, delivering 70B-class results at a fraction of the compute cost. One of the best open-weight models available under a fully permissive license.
Params
47B
License
Apache 2.0
Context
32K
Min VRAM
26 GB
Min RAM
32 GB
Tier
Heavy
Run locally with Ollama
ollama run mixtral:8x7bOnce running, Ollama exposes an OpenAI-compatible endpoint at localhost:11434/v1.
Will it run on my hardware?
Mixtral 8x7B needs about 26 GB of fast memory at Q4. Here is what in our hardware database clears that bar.
Runs at full speed · 3
Runs, but slower on shared memory · 3
9 other tracked configurations do not have enough memory.
Hardware links are affiliate links. We earn a small commission if you buy through them — at no extra cost to you. Disclosure
Specifications
| Parameters | 47B |
|---|---|
| Context window | 32K |
| License | Apache 2.0 |
| Min VRAM (Q4) | 26 GB |
| Min RAM | 32 GB |
| Recommended tier | Heavy |
| Best for | codinganalysischatcreative writing |
Variants on Ollama
Ollama serves the Q4_K_M quantization by default. Higher-precision tags exist for users with more memory.
Mixtral 8x7B
ollama run mixtral:8x7bollama pull mixtral:q8_0ollama pull mixtral:fp16Exact quantization tags vary per model — run ollama show mixtral or check the tags page for the full list.
Popularity trend (illustrative)
Illustrative adoption trend, not actual download counts. We do not publish a download number for any model because we have no honest source for it.
Similar models
Gemma 3 27B
Google · Gemma Terms of Use
The largest Gemma 3 model and one of the best open-weight models in the 20–30B range. Fits in a single RTX 4090 (24 GB) with room to spare at Q4 quantization, and delivers instruction-following quality that rivals models twice its size.
Min VRAM
15 GB
Context
128K
Run with Ollama
ollama run gemma3:27bLlama 3.3 70B
Meta · Llama 3.3 Community
Meta's flagship open-weight model and the go-to choice for users who want GPT-4-class performance without sending data to the cloud. Consistently tops open-source leaderboards. Needs ~48 GB VRAM at Q4_K_M — a dual-GPU rig or Apple Silicon with 48 GB unified memory.
Min VRAM
48 GB
Context
128K
Run with Ollama
ollama run llama3.3:70bLlama 3.1 8B
Meta · Llama 3.1 Community
Meta's 8B workhorse with a massive 128K context window. Punches well above its weight class for everyday coding and chat tasks, runs comfortably on any consumer GPU with 6 GB VRAM, and delivers near-70B quality on many benchmarks.
Min VRAM
5 GB
Context
128K
Run with Ollama
ollama run llama3.1:8b