Ollama

Run open language models on your own computer with one command.

Visit website(opens in a new tab)

Overview

Ollama downloads and runs open models locally and exposes them through a simple API, so your prompts never leave your machine.

Features

  • One-command model download and run
  • Local API compatible with common clients
  • Large library of open models
  • Works offline

Use cases

  • Private chat with sensitive documents
  • Developing against a local model
  • Experimenting with open models

Articles about this tool