In this categoryLocal AI · 70
- Speridlabs Idol: Turn One Photo into a 3D Gaussian Splat, and How to Run It
- LFM3-Omni-2B: Liquid AI's 2.2B Any-to-Any Model, and How to Run It Locally
- SenseNova-Loop-9B-Preview: A Looped Multimodal Model for Long-Context Work, and How to Run It
- How to Run WeVisOne-VL-4B Locally: Tencent's All-in-One Vision Model
- How to Run Mistral Large 4 (1T-A52B) Locally: The Hardware It Actually Needs
- How to Run Hy-SimulMT-30B-A3B-FP8 Locally: Tencent's Real-Time Speech Translator
- How to Run Chroma1-HD Locally: An Open Base Model for Text-to-Image
- How to Run Nemotron 3.5 Parse Locally: NVIDIA's 630M Document Parsing Model
- How to Run Recursive Flint Locally: a 39.8B Coding Model You Can Actually Fit on a Mac
- How to Run Phonon-40M-en Locally: Gradium's 40M-Parameter Text-to-Speech Model
- How to Run Timestral-209M Locally: Mistral's 209M-Parameter Time Series Forecasting Model
- How to Run Indra OCR Locally: a 1M-Parameter CPU Model That Hits 49 Pages a Second
- How to Run AuroraIMG-6M Locally: AuroraAI-Research's 6.82M-Parameter Text-to-Image Model
- How to Run Maya-1 Locally: a 3.3B-Parameter Text-to-Speech Model with Voice Design
- How to Run Sopro V2 Turbo Locally: a 120M-Parameter Voice Cloning TTS Model
- How to Run Kova TTS 1 Locally: a 1.25B-Parameter Voice Cloning Model for Narration
- How to Run Whistle Locally: Cactus's 16.9MB On-Device Speech Recognition Model
- How to Run Antalia-2 Mini Locally: a 7.6M-Parameter Turkish TTS Model
- How to Run Supra2-IMG Locally: SupraLabs' 104M-Parameter Text-to-Image Model
- How to Run VisionHOPE Locally: PSRben's Self-Modifying Vision Backbone
- Fish Audio S1-Mini: What It Is and How to Actually Try It
- How to Run SupraTTS-0.1-Beta Locally: A Tiny Glow-TTS Voice Model
- How to Run Nemotron 3 Diarization Locally: Streaming Speaker Tagging in 99M Parameters
- How to Run Freya-TTS Locally: A 183M-Parameter Turkish Text-to-Speech Model
- How to Run Audio8 ASR Infinite Locally: Streaming Speech Recognition That Never Stops
- How to Run TeleOCR Locally: One Model for Scanned and Photographed Documents
- How to Run Xing4.0-29B-A4B Locally: A 256K-Context MoE Model for Agent Tasks
- How to Run IndicF5 Locally: Voice Cloning for 11 Indian Languages
- How to Run Fish Audio S2 Pro Locally: Multilingual TTS with Inline Emotion Control
- How to Run ZDTaichu5.0-9B Locally: A 9.79B Vision-Language Model Built for Spatial Reasoning
- How to Run Qwen3-TTS-12Hz-1.7B-VoiceDesign Locally: Voice Design From a Text Description
- How to Run YuE2-3B Locally: Open Source Music Generation That Beats Suno v5 on Benchmarks
- MiniCPM5-2B: Install and Run OpenBMB's 2B Model That Outscores 4B Rivals
- BERT Base Uncased: Specs, How to Run It, and Why It's Still Trending in 2026
- How to Run tencent/AuK Locally: Zero-Shot TTS, Voice Cloning and Speech Editing
- Stable Diffusion 3.5 Medium: What's Different From SDXL and Flux
- Qwen-Image-2512: The Text-to-Image Model That Renders Real Text
- How to Run Irodori-TTS Anime Locally: Japanese Voice Cloning and Voice Design
- How to Run Breeze TTS 2 Locally: Voice Clone, Voice Design and Voice Direction
- How to Run Kokoro-82M Locally: the Fastest Open-Weight TTS Model
- How to Install Ollama on macOSStart
- How to Install Ollama on Windows
- How to Run Llama 3 Locally with Ollama
- How to Pick the Right Local AI Model for Your Hardware
- Best GGUF Models to Run by VRAM Tier (8GB, 12GB, 16GB, 24GB, 48GB)
- Run LLMs in Your Browser With WebGPU: No Install, No Server (WebLLM)
- How to Use Ollama as a Drop-In OpenAI API
- GGUF vs MLX vs NVFP4: Local AI Quantization Formats Explained
- Best GPU for Running AI Locally in 2026Start
- How Much RAM Do You Need for Local AI?
- Mac vs PC for Local AI: Which Should You Choose?
- How to Build a Local AI Workstation on Any Budget
- How to Set Up Local AI on 8GB of VRAM
- How to Set Up Local AI on 12GB of VRAM
- Best Local LLM for 16 GB VRAM: Setup, Quantization and Real Speed
- How to Set Up Local AI on 24GB of VRAM
- Best Local LLM on Mac M4 16 GB: Setup, MLX vs GGUF and Real Speed
- Best Local LLM on Mac M4 Pro 48GB: Setup, Quantization and Real Speed
How to Install Ollama on macOS
Get Ollama running on a Mac in under 10 minutes: install via Homebrew or the native app, pull your first model, and confirm the local server is responding.
Ollama is the fastest way to run large language models on your own hardware. It manages model downloads, GPU acceleration, and a local HTTP server that speaks the OpenAI API format. On macOS, there are two install paths: a Homebrew formula for people who live in the terminal, and a native app for everyone else. This guide covers both.
What you need
- A Mac with Apple Silicon (M1/M2/M3/M4) or an Intel Mac with at least 8 GB RAM
- macOS 12 Monterey or newer
- Homebrew installed (optional but recommended)
- About 5 GB of free disk space for a small model
Option A: Install with Homebrew
Homebrew is the cleanest path because it handles updates with a single command. Open Terminal and run the two commands below. The first installs the Ollama formula from the core tap; the second starts the background service.
The service starts automatically on login. To stop it, run brew services stop ollama. To update later, run brew upgrade ollama.
Option B: Install the native app
If you prefer a menu-bar app over a background service, download the macOS installer directly from ollama.com. The .dmg contains a standard macOS application. Drag it to /Applications and open it. A small llama icon appears in your menu bar when the server is running.
Step 2: Pull and run your first model
The ollama run command pulls a model on the first invocation and then opens an interactive chat prompt. Llama 3.3 is Meta's flagship open model and a solid first choice. The 8B variant fits in 8 GB of RAM.
The model weights are cached in ~/.ollama/models after the first pull, so subsequent runs start in seconds. You can run ollama pull llama3.3 separately to download in the background without opening a chat.
Step 3: Verify the local server responds
Ollama starts an HTTP server on localhost:11434. You can check it is running and list downloaded models with a simple curl request. This is also the endpoint used by any client library or app that integrates with Ollama.
Managing models
Use the ollama CLI to manage what is stored on disk. Models live under ~/.ollama/models and can be several gigabytes each, so cleaning up unused ones matters.
- ollama list — show all downloaded models with size and modification date
- ollama pull mistral — download a model without running it
- ollama rm llama3.3 — delete a model from disk
- ollama show llama3.3 — print the model card (context length, architecture, license)
At this point Ollama is installed, a model is cached locally, and the API server is responding on port 11434. The next step is using the OpenAI-compatible endpoint from your own code, which is covered in the guide on using Ollama as a drop-in OpenAI API.
Local models run better with more VRAM. CompareRTX GPUs on Amazonbefore you upgrade.(affiliate link. We may earn a commission at no extra cost. Disclosure)
Watch related tutorials
9:42
8:55
11:05
10:30
12:20
9:50Weekly local AI drops
New models, what runs on your hardware, and the guides to set them up. One email a week, unsubscribe any time.