Fastest Lightweight Local AI Models
Light-tier models that ask the least of your hardware and respond fast, sorted smallest-VRAM first so you can start with the leanest option.
Llama 3.1 8B
Meta · Llama 3.1 Community
Meta's 8B workhorse with a massive 128K context window. Punches well above its weight class for everyday coding and chat tasks, runs comfortably on any consumer GPU with 6 GB VRAM, and delivers near-70B quality on many benchmarks.
Min VRAM
5 GB
Context
128K
Run with Ollama
ollama run llama3.1:8bLlama 3.2 3B
Meta · Llama 3.2 Community
The smallest production-quality Llama model, designed to run on laptops, Raspberry Pis, and other edge devices with minimal VRAM. Response latency is sub-second on modern CPUs, making it ideal for real-time assistants and local automation scripts.
Min VRAM
2 GB
Context
128K
Run with Ollama
ollama run llama3.2:3bQwen3 8B
Alibaba · Apache 2.0
One of the most-downloaded mid-size AI models on HuggingFace in 2026, with tens of millions of downloads. Qwen3 8B outperforms the previous Qwen2.5 14B on most benchmarks, supports hybrid thinking mode and tool calling, and runs on any GPU with 6 GB VRAM. Apache 2.0 license — fully commercial.
Min VRAM
5 GB
Context
128K
Run with Ollama
ollama run qwen3:8bMistral 7B v0.3
Mistral AI · Apache 2.0
The model that proved 7B parameters can match much larger models on reasoning tasks when trained carefully. Apache 2.0 licensed, so it is fully free to use commercially with no restrictions.
Min VRAM
4 GB
Context
32K
Run with Ollama
ollama run mistral:7bGemma 3 4B
Google · Gemma Terms of Use
Google's compact Gemma 3 model brings the quality of a much larger system into a 4B package that runs on integrated graphics. A strong first choice for anyone wanting a capable, low-power model without needing a discrete GPU.
Min VRAM
3 GB
Context
128K
Run with Ollama
ollama run gemma3:4bQwen 2.5 Coder 7B
Alibaba · Apache 2.0
A coding-specialist model fine-tuned on a massive corpus of source code across 40+ programming languages, delivering autocomplete and generation quality that rivals dedicated IDE tools. At 7B it is fast enough for real-time code suggestions on a single consumer GPU.
Min VRAM
4 GB
Context
128K
Run with Ollama
ollama run qwen2.5-coder:7bKokoro-82M
hexgrad · Apache 2.0
The most-downloaded text-to-speech model on HuggingFace by a wide margin, at 11.6M downloads a month. At just 82M parameters it is small enough to run on CPU alone — no GPU minimum is published, unlike most other speech models here. Apache 2.0 licensed, so it is fully free for commercial use with no restrictions. Ships with 8 languages and 54 voices out of the box.
Min VRAM
None published — small enough to run on CPU alone
Speed
—
Install & run
pip install -q kokoro>=0.9.2 soundfileOmniVoice
k2-fsa · Apache 2.0 (code) / CC BY-NC (pretrained weights)
A zero-shot voice-cloning model from the k2-fsa (Next-gen Kaldi) team with the broadest language coverage of any open TTS model — 600+ languages from a single checkpoint. The code is Apache 2.0, but the pretrained weights are CC BY-NC because of constraints in the Emilia training data, so the released checkpoint is not free for commercial use without separate authorization.
Min VRAM
Not published — tested on server-class GPUs; also runs on Apple Silicon (MPS) and Intel Arc (XPU)
Speed
—
Install & run
pip install torch==2.8.0+cu128 torchaudio==2.8.0+cu128 --extra-index-url https://download.pytorch.org/whl/cu128Want to mix in more filters?
Open the faceted model browser to combine VRAM, family, license, developer and task filters, then sort the results your way.