Vision

Analyze images with AI

Agents can see and understand images – describe content, read text, and answer questions.

Quick Start

1. Simple Usage

   import { Agent } from 'praisonai';
   
   const agent = new Agent({
     instructions: 'You describe images in detail',
     llm: 'gpt-4o'  // Vision-capable model
   });
   
   await agent.chat([
     { role: 'user', content: [
       { type: 'text', text: 'What is in this image?' },
       { type: 'image', url: 'https://example.com/photo.jpg' }
     ]}
   ]);

2. With Configuration

   await agent.chat([
     { role: 'user', content: [
       { type: 'text', text: 'Describe this image' },
       { type: 'image', path: './my-photo.jpg' }
     ]}
   ]);

User Interaction Flow

Configuration Levels

// Level 1: Bool - Enable with vision model
const agent = new Agent({
  llm: 'gpt-4o',  // Vision-capable
  vision: true
});

// Level 2: String - Specify detail level
const agent = new Agent({
  llm: 'gpt-4o',
  vision: 'high'  // 'low', 'auto', 'high'
});

// Level 3: Dict - Full options
const agent = new Agent({
  llm: 'gpt-4o',
  vision: {
    detail: 'high',
    maxImages: 5
  }
});

What You Can Do

API Reference

Best Practices

Related