Ollama
Ollama is a tool for running open-source large language models locally. It simplifies downloading, running, and managing models via a CLI and REST API, and integrates with coding assistants and chat applications. It is for developers who want to build or test AI features with local models.
🎬 Learn Ollama in 15 Minutes - Run LLM Models Locally for FREE · Tech With Tim
✨ Key features
- Run open models locally with simple CLI commands
- REST API for model management and chat
- Launch integrations like Claude Code, Codex, Copilot
- Turn Ollama into AI assistant via OpenClaw
- Official Docker image and Python/JS libraries
- Supports many community integrations and SDKs
🎯 Use cases
- Chat with models like Gemma 4 locally
- Integrate local models into coding assistants
- Build AI assistants for messaging platforms
- Develop applications using REST API or SDKs
- Run RAG systems with local embeddings
📦 Installation
🧰 Requirements: Runs on macOS, Windows, Linux, or via Docker. No API keys required for local use.
macOS
curl -fsSL https://ollama.com/install.sh | sh
Windows
irm https://ollama.com/install.ps1 | iex
Linux
curl -fsSL https://ollama.com/install.sh | sh
Docker
The official Ollama Docker image ollama/ollama is available on Docker Hub.
🚀 Usage
Chat with a model
Run and chat with Gemma 4:
ollama run gemma4
REST API
curl http://localhost:11434/api/chat -d '{
"model": "gemma4",
"messages": [{
"role": "user",
"content": "Why is the sky blue?"
}],
"stream": false
}'
❓ FAQ
How do I install Ollama?
You can install via a shell script on macOS and Linux, a PowerShell script on Windows, or download the installer manually. Docker image is also available.
How do I run a model?
Use the command ollama run <model-name>, for example ollama run gemma4 to chat with Gemma 4.
Can I use Ollama with programming languages?
Yes, there are official Python and JavaScript libraries, and community SDKs for many languages like Java, Go, Rust, and .NET.
Does Ollama provide an API?
Yes, it has a REST API for running and managing models, with endpoints like /api/chat.
📊 Repository
🤖 Overview, features, install steps and FAQ were generated from the project's README on Sep 4, 2026. Always check the original source before running commands.