> ## Documentation Index
> Fetch the complete documentation index at: https://praison.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Evaluation CLI

> CLI commands for evaluation in PraisonAI TypeScript

The `praisonai-ts` CLI provides the `eval` command for agent evaluation.

```mermaid theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
graph LR
    User([User]) --> CLI[CLI]
    CLI --> Svc[Evaluation]

    classDef agent fill:#8B0000,stroke:#7C90A0,color:#fff
    classDef tool fill:#189AB4,stroke:#7C90A0,color:#fff

    class Svc agent
    class User,CLI tool
    classDef agent fill:#8B0000,color:#fff
    classDef tool fill:#189AB4,color:#fff

```

## Quick Start

<Steps>
  <Step title="Simple Usage">
    ```bash theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
    praisonai-ts eval accuracy --input "2+2" --expected "4"
    ```
  </Step>

  <Step title="With Configuration">
    ```bash theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
    praisonai-ts eval performance --iterations 10 --json
    ```
  </Step>
</Steps>

## Accuracy Evaluation

```bash theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
# Run accuracy evaluation
praisonai-ts eval accuracy --input "2+2" --expected "4"

# With multiple iterations
praisonai-ts eval accuracy --input "What is 2+2?" --expected "4" --iterations 3 --json
```

## Performance Evaluation

```bash theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
# Run performance benchmark
praisonai-ts eval performance --iterations 10

# With warmup runs
praisonai-ts eval performance --iterations 50 --warmup 5 --json
```

## Reliability Evaluation

```bash theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
# Check tool call reliability
praisonai-ts eval reliability --expected-tools "calculator,web_search"
```

## SDK Usage

For programmatic evaluation:

```typescript theme={"theme":{"light":"vitesse-light","dark":"vitesse-dark"}}
import { AccuracyEval, PerformanceEval, ReliabilityEval } from 'praisonai';

// Accuracy evaluation
const accuracy = new AccuracyEval({
  agent: myAgent,
  input: "What is 2+2?",
  expectedOutput: "4",
  numIterations: 3
});
const result = await accuracy.run();

// Performance evaluation
const perf = new PerformanceEval({
  func: () => agent.chat("Hello"),
  numIterations: 50,
  warmupRuns: 10
});
const perfResult = await perf.run();
```

For more details, see the [Evaluation SDK documentation](/docs/js/evaluation).

## Related

<CardGroup cols={2}>
  <Card title="Evaluation" icon="book" href="/docs/js/evaluation">Evaluation overview</Card>
  <Card title="Benchmarks CLI" icon="robot" href="/docs/js/benchmarks-cli">Benchmarks CLI overview</Card>
</CardGroup>