Llama 3.2 3B
Meta · Llama
The smallest production-quality Llama model, designed to run on laptops, Raspberry Pis, and other edge devices with minimal VRAM. Response latency is sub-second on modern CPUs, making it ideal for real-time assistants and local automation scripts.
Params
3B
License
Llama 3.2 Community
Context
128K
Min VRAM
2 GB
Min RAM
4 GB
Tier
Light
Run locally with Ollama
ollama run llama3.2:3bOnce running, Ollama exposes an OpenAI-compatible endpoint at localhost:11434/v1.
Will it run on my hardware?
Llama 3.2 3B needs about 2 GB of fast memory at Q4. Here is what in our hardware database clears that bar.
Runs at full speed · 12
Runs, but slower on shared memory · 3
Hardware links are affiliate links. We earn a small commission if you buy through them — at no extra cost to you. Disclosure
Specifications
| Parameters | 3B |
|---|---|
| Context window | 128K |
| License | Llama 3.2 Community |
| Min VRAM (Q4) | 2 GB |
| Min RAM | 4 GB |
| Recommended tier | Light |
| Best for | chatedge deploymentsummarization |
Variants on Ollama
Ollama serves the Q4_K_M quantization by default. Higher-precision tags exist for users with more memory.
Llama 3.2 3B
ollama run llama3.2:3bollama pull llama3.2:q8_0ollama pull llama3.2:fp16Exact quantization tags vary per model — run ollama show llama3.2 or check the tags page for the full list.
Popularity trend (illustrative)
Illustrative adoption trend, not actual download counts. We do not publish a download number for any model because we have no honest source for it.
Similar models
Mistral 7B v0.3
Mistral AI · Apache 2.0
The model that proved 7B parameters can match much larger models on reasoning tasks when trained carefully. Apache 2.0 licensed, so it is fully free to use commercially with no restrictions.
Min VRAM
4 GB
Context
32K
Run with Ollama
ollama run mistral:7bGemma 3 4B
Google · Gemma Terms of Use
Google's compact Gemma 3 model brings the quality of a much larger system into a 4B package that runs on integrated graphics. A strong first choice for anyone wanting a capable, low-power model without needing a discrete GPU.
Min VRAM
3 GB
Context
128K
Run with Ollama
ollama run gemma3:4bLlama 3.1 8B
Meta · Llama 3.1 Community
Meta's 8B workhorse with a massive 128K context window. Punches well above its weight class for everyday coding and chat tasks, runs comfortably on any consumer GPU with 6 GB VRAM, and delivers near-70B quality on many benchmarks.
Min VRAM
5 GB
Context
128K
Run with Ollama
ollama run llama3.1:8b