In this categoryLocal AI · 24
- How to Install Ollama on macOSStart
- How to Install Ollama on Windows
- How to Run Llama 3 Locally with Ollama
- How to Pick the Right Local AI Model for Your Hardware
- Best GGUF Models to Run by VRAM Tier (8GB, 12GB, 16GB, 24GB, 48GB)
- Run LLMs in Your Browser With WebGPU: No Install, No Server (WebLLM)
- How to Use Ollama as a Drop-In OpenAI API
- GGUF vs MLX vs NVFP4: Local AI Quantization Formats Explained
How to Install Ollama on Windows
Download the Windows installer, confirm PATH is set, verify the local API server is up, and understand when WSL2 gives you better GPU performance.
Ollama has shipped a native Windows installer since version 0.1.9. It installs an ollamad system service, sets up PATH, and bundles the llama.cpp backend with CUDA support for NVIDIA GPUs. You do not need WSL to get started, though WSL2 is worth considering if you run into GPU sharing issues.
What you need
- Windows 10 22H2 or Windows 11 (64-bit)
- At least 8 GB RAM (16 GB recommended for 8B models)
- NVIDIA GPU with CUDA 11.8+ drivers for GPU acceleration (CPU-only also works)
- About 5 GB of free disk space per model
- No administrator rights required for the user install
Step 1: Download and run the installer
Go to ollama.com and click the Download for Windows button. This gives you OllamaSetup.exe, a standard Windows installer under 500 MB. Run it and accept the UAC prompt. The installer does three things: extracts the binary to %LOCALAPPDATA%\Programs\Ollama, adds that directory to your user PATH, and registers a Windows service that starts on login.
Step 2: Pull and run a model
Open a new PowerShell or Command Prompt window. The ollama run command downloads the model on first use and then opens an interactive prompt. Use llama3.3 for a capable general-purpose model, or phi4-mini for something that runs faster on lower-end hardware.
Step 3: Verify the local server
Ollama starts an HTTP API on localhost:11434. Check it responds before pointing any client library at it. PowerShell's Invoke-WebRequest works, or use curl.exe which ships with Windows 10 1803 and newer.
Step 4: NVIDIA GPU check
If you have an NVIDIA GPU, Ollama automatically uses CUDA when the driver version is 525 or higher. Confirm it is being used by checking the logs or running a quick generation and watching GPU load in Task Manager.
Useful management commands
- ollama list — show downloaded models
- ollama rm modelname — free disk space by removing a model
- ollama ps — show currently loaded models and their memory usage
- ollama serve — start the server manually if the service is not running
- Get-Service ollamad — check the Windows service status in PowerShell
Ollama is now running as a Windows service and the API is live on port 11434. From here you can pull any model from the Ollama model library at ollama.com/library and use it from Python, Node, or any OpenAI-compatible SDK without sending data to an external server.
Local models run better with more VRAM. CompareRTX GPUs on Amazonbefore you upgrade.(affiliate link. We may earn a commission at no extra cost. Disclosure)
Watch related tutorials
12:20
9:50
10:45
9:42
8:55
10:30Weekly local AI drops
New models, what runs on your hardware, and the guides to set them up. One email a week, unsubscribe any time.