Skip to main content

Ollama Provider

Run models locally with Ollama.

Environment Variables

Supported Modalities

Prerequisites

  1. Install Ollama: https://ollama.ai
  2. Pull a model: ollama pull llama3.2

Quick Start

1

Simple Usage

2

With Configuration

Adjust provider credentials and model settings for production — see the sections above.

Available Models

Ollama CLI Usage

Ollama CLI Usage

Local Providers

Local Providers