Performance Benchmarks

Measure import time, memory usage, and lazy-import compliance for PraisonAI Agents

Verify your agent stack meets performance targets — import under 200 ms, heavy deps loaded only when needed.

from praisonaiagents import Agent

# Silent output (default) keeps import overhead minimal
agent = Agent(name="Bench", instructions="You are helpful.")
result = agent.start("Say hello in one word")

The user runs a lightweight agent; benchmarks verify import time and lazy-loading stay within targets.

Quick Start

1. Simple Usage

   Run the built-in benchmark from the CLI:

   pip install praisonai
   praisonai perf benchmark

2. With Configuration

   Add a CI gate that fails on agent-instantiation regressions using the built-in benchmark:

   # .github/workflows/agent-performance.yml
   name: agent-performance
   on:
     pull_request:
       paths:
         - 'src/praisonai-agents/praisonaiagents/**'
         - 'src/praisonai-agents/benchmarks/**'
   jobs:
     benchmark:
       runs-on: ubuntu-latest
       timeout-minutes: 5
       steps:
         - uses: actions/checkout@v4
         - uses: actions/setup-python@v5
           with:
             python-version: '3.11'
         - run: pip install -e src/praisonai-agents
         - name: Run benchmark with threshold gate
           working-directory: src/praisonai-agents
           run: python benchmarks/simple_benchmark.py --skip-crewai --json --fail-over-threshold | tee agent-perf-baseline.json
         - uses: actions/upload-artifact@v4
           with:
             name: agent-perf-baseline
             path: src/praisonai-agents/agent-perf-baseline.json

   Budgets live in src/praisonai-agents/benchmarks/thresholds.json:

   {
     "praisonai_instantiation_us_max": 150,
     "iterations": 100,
     "warmup": 10
   }

Performance Targets

How It Works

CLI commands

praisonai perf benchmark    # Full suite
praisonai perf import-time  # Import time only
praisonai perf memory       # Memory usage only
praisonai perf lazy-check   # Verify lazy imports

Python benchmark scripts

From the SDK repo:

python benchmarks/import_time.py
python benchmarks/memory_usage.py

Configuration Options

Typical results (agent instantiation measured 2026-10-15 on Linux x86_64, 4 CPUs, see BENCHMARK_RESULTS.md):

Best Practices

Related