Run LLMs Locally on Your Mac with Ollama

Apple announced Apple Intelligence at WWDC 2024, promising "AI for the rest of us," but its arrival feels distant. Meanwhile, Ollama lets you run large language models (LLMs) like llama3.2 locally on your Mac. Think of it as 'Docker for LLMs' – easy to pull, run, and manage models. Powered by llama.cpp, Ollama uses Modelfiles for configuration and the OCI standard for distribution. Running models locally offers advantages in privacy, cost, latency, and reliability. Ollama exposes an HTTP API for easy integration into apps, as demonstrated by Nominate.app, which uses it for intelligent PDF renaming. The article encourages developers to build the next generation of AI-powered apps now with Ollama, instead of waiting for Apple's promises.