Praison AI

Performance CLI

CLI commands for performance benchmarking and regression testing

Performance CLI

Commands for measuring and verifying performance of PraisonAI Agents.

Commands

Full Benchmark

Run a complete performance benchmark:

bash
praisonai perf benchmark

Output:

============================================================
PraisonAI Agents Performance Benchmark
============================================================

[1/3] Measuring import time...
      Median: 18.4ms [PASS]

[2/3] Measuring memory usage...
      Current: 33.0MB [WARN]

[3/3] Checking lazy imports...
      All lazy: True [PASS]
        ✓ litellm
        ✓ chromadb
        ✓ mem0
        ✓ requests

============================================================
Overall: [PASS]
============================================================

Import Time Only

Measure just the import time:

bash
praisonai perf import-time

Output:

Import time: 18.4ms (median)
Target: <200ms
Status: PASS

Memory Usage Only

Measure just the memory usage:

bash
praisonai perf memory

Output:

Memory: 33.0MB
Target: <30MB
Status: WARN

Lazy Import Check

Verify lazy imports are working:

bash
praisonai perf lazy-check

Output:

Lazy Import Check:
  litellm: LAZY (good)
  chromadb: LAZY (good)
  mem0: LAZY (good)
  requests: LAZY (good)

Regression Check

Run a pass/fail check for CI/CD:

bash
praisonai perf check

Returns exit code 0 on pass, 1 on fail.

Performance Targets

MetricTargetHard Fail
Import Timeless than 200msgreater than 300ms
Memory Usageless than 30MBgreater than 45MB
Lazy ImportsAll lazyAny eager

CI/CD Integration

Use in GitHub Actions:

yaml
- name: Performance Check
  run: |
    pip install praisonaiagents
    praisonai perf check

Use in shell scripts:

bash
#!/bin/bash
if praisonai perf check; then
    echo "Performance check passed"
else
    echo "Performance regression detected"
    exit 1
fi

Subcommands Reference

CommandDescription
praisonai perf benchmarkRun full benchmark suite
praisonai perf import-timeMeasure import time only
praisonai perf memoryMeasure memory usage only
praisonai perf lazy-checkVerify lazy imports
praisonai perf checkCI/CD regression check

Related