DeepInfra Provider

Fast inference with DeepInfra.

Environment Variables

export DEEPINFRA_API_KEY=...

Quick Start

1

Simple Usage

import { Agent } from 'praisonai';

const agent = new Agent({
  name: 'DeepInfraAgent',
  instructions: 'You are a helpful assistant.',
  llm: 'deepinfra/meta-llama/Llama-2-70b-chat-hf'
});

const response = await agent.chat('Hello!');

2

With Configuration

Adjust provider credentials and model settings for production — see the sections above.

DeepInfra CLI Usage

DeepInfra CLI Usage