In this categoryLocal AI · 70
- Speridlabs Idol: Turn One Photo into a 3D Gaussian Splat, and How to Run It
- LFM3-Omni-2B: Liquid AI's 2.2B Any-to-Any Model, and How to Run It Locally
- SenseNova-Loop-9B-Preview: A Looped Multimodal Model for Long-Context Work, and How to Run It
- How to Run WeVisOne-VL-4B Locally: Tencent's All-in-One Vision Model
- How to Run Mistral Large 4 (1T-A52B) Locally: The Hardware It Actually Needs
- How to Run Hy-SimulMT-30B-A3B-FP8 Locally: Tencent's Real-Time Speech Translator
- How to Run Chroma1-HD Locally: An Open Base Model for Text-to-Image
- How to Run Nemotron 3.5 Parse Locally: NVIDIA's 630M Document Parsing Model
- How to Run Recursive Flint Locally: a 39.8B Coding Model You Can Actually Fit on a Mac
- How to Run Phonon-40M-en Locally: Gradium's 40M-Parameter Text-to-Speech Model
- How to Run Timestral-209M Locally: Mistral's 209M-Parameter Time Series Forecasting Model
- How to Run Indra OCR Locally: a 1M-Parameter CPU Model That Hits 49 Pages a Second
- How to Run AuroraIMG-6M Locally: AuroraAI-Research's 6.82M-Parameter Text-to-Image Model
- How to Run Maya-1 Locally: a 3.3B-Parameter Text-to-Speech Model with Voice Design
- How to Run Sopro V2 Turbo Locally: a 120M-Parameter Voice Cloning TTS Model
- How to Run Kova TTS 1 Locally: a 1.25B-Parameter Voice Cloning Model for Narration
- How to Run Whistle Locally: Cactus's 16.9MB On-Device Speech Recognition Model
- How to Run Antalia-2 Mini Locally: a 7.6M-Parameter Turkish TTS Model
- How to Run Supra2-IMG Locally: SupraLabs' 104M-Parameter Text-to-Image Model
- How to Run VisionHOPE Locally: PSRben's Self-Modifying Vision Backbone
- Fish Audio S1-Mini: What It Is and How to Actually Try It
- How to Run SupraTTS-0.1-Beta Locally: A Tiny Glow-TTS Voice Model
- How to Run Nemotron 3 Diarization Locally: Streaming Speaker Tagging in 99M Parameters
- How to Run Freya-TTS Locally: A 183M-Parameter Turkish Text-to-Speech Model
- How to Run Audio8 ASR Infinite Locally: Streaming Speech Recognition That Never Stops
- How to Run TeleOCR Locally: One Model for Scanned and Photographed Documents
- How to Run Xing4.0-29B-A4B Locally: A 256K-Context MoE Model for Agent Tasks
- How to Run IndicF5 Locally: Voice Cloning for 11 Indian Languages
- How to Run Fish Audio S2 Pro Locally: Multilingual TTS with Inline Emotion Control
- How to Run ZDTaichu5.0-9B Locally: A 9.79B Vision-Language Model Built for Spatial Reasoning
- How to Run Qwen3-TTS-12Hz-1.7B-VoiceDesign Locally: Voice Design From a Text Description
- How to Run YuE2-3B Locally: Open Source Music Generation That Beats Suno v5 on Benchmarks
- MiniCPM5-2B: Install and Run OpenBMB's 2B Model That Outscores 4B Rivals
- BERT Base Uncased: Specs, How to Run It, and Why It's Still Trending in 2026
- How to Run tencent/AuK Locally: Zero-Shot TTS, Voice Cloning and Speech Editing
- Stable Diffusion 3.5 Medium: What's Different From SDXL and Flux
- Qwen-Image-2512: The Text-to-Image Model That Renders Real Text
- How to Run Irodori-TTS Anime Locally: Japanese Voice Cloning and Voice Design
- How to Run Breeze TTS 2 Locally: Voice Clone, Voice Design and Voice Direction
- How to Run Kokoro-82M Locally: the Fastest Open-Weight TTS Model
- How to Install Ollama on macOSStart
- How to Install Ollama on Windows
- How to Run Llama 3 Locally with Ollama
- How to Pick the Right Local AI Model for Your Hardware
- Best GGUF Models to Run by VRAM Tier (8GB, 12GB, 16GB, 24GB, 48GB)
- Run LLMs in Your Browser With WebGPU: No Install, No Server (WebLLM)
- How to Use Ollama as a Drop-In OpenAI API
- GGUF vs MLX vs NVFP4: Local AI Quantization Formats Explained
- Best GPU for Running AI Locally in 2026Start
- How Much RAM Do You Need for Local AI?
- Mac vs PC for Local AI: Which Should You Choose?
- How to Build a Local AI Workstation on Any Budget
- How to Set Up Local AI on 8GB of VRAM
- How to Set Up Local AI on 12GB of VRAM
- Best Local LLM for 16 GB VRAM: Setup, Quantization and Real Speed
- How to Set Up Local AI on 24GB of VRAM
- Best Local LLM on Mac M4 16 GB: Setup, MLX vs GGUF and Real Speed
- Best Local LLM on Mac M4 Pro 48GB: Setup, Quantization and Real Speed
How to Install Ollama on Windows
Download the Windows installer, confirm PATH is set, verify the local API server is up, and understand when WSL2 gives you better GPU performance.
Ollama has shipped a native Windows installer since version 0.1.9. It installs an ollamad system service, sets up PATH, and bundles the llama.cpp backend with CUDA support for NVIDIA GPUs. You do not need WSL to get started, though WSL2 is worth considering if you run into GPU sharing issues.
What you need
- Windows 10 22H2 or Windows 11 (64-bit)
- At least 8 GB RAM (16 GB recommended for 8B models)
- NVIDIA GPU with CUDA 11.8+ drivers for GPU acceleration (CPU-only also works)
- About 5 GB of free disk space per model
- No administrator rights required for the user install
Step 1: Download and run the installer
Go to ollama.com and click the Download for Windows button. This gives you OllamaSetup.exe, a standard Windows installer under 500 MB. Run it and accept the UAC prompt. The installer does three things: extracts the binary to %LOCALAPPDATA%\Programs\Ollama, adds that directory to your user PATH, and registers a Windows service that starts on login.
Step 2: Pull and run a model
Open a new PowerShell or Command Prompt window. The ollama run command downloads the model on first use and then opens an interactive prompt. Use llama3.3 for a capable general-purpose model, or phi4-mini for something that runs faster on lower-end hardware.
Step 3: Verify the local server
Ollama starts an HTTP API on localhost:11434. Check it responds before pointing any client library at it. PowerShell's Invoke-WebRequest works, or use curl.exe which ships with Windows 10 1803 and newer.
Step 4: NVIDIA GPU check
If you have an NVIDIA GPU, Ollama automatically uses CUDA when the driver version is 525 or higher. Confirm it is being used by checking the logs or running a quick generation and watching GPU load in Task Manager.
Useful management commands
- ollama list — show downloaded models
- ollama rm modelname — free disk space by removing a model
- ollama ps — show currently loaded models and their memory usage
- ollama serve — start the server manually if the service is not running
- Get-Service ollamad — check the Windows service status in PowerShell
Ollama is now running as a Windows service and the API is live on port 11434. From here you can pull any model from the Ollama model library at ollama.com/library and use it from Python, Node, or any OpenAI-compatible SDK without sending data to an external server.
Local models run better with more VRAM. CompareRTX GPUs on Amazonbefore you upgrade.(affiliate link. We may earn a commission at no extra cost. Disclosure)
Watch related tutorials
12:20
9:50
10:45
9:42
8:55
10:30Weekly local AI drops
New models, what runs on your hardware, and the guides to set them up. One email a week, unsubscribe any time.