eval • Rust AI Agent SDK
Evaluation Module for PraisonAI Rust SDK.
eval
Rust AI Agent SDK
Evaluation Module for PraisonAI Rust SDK.
Provides comprehensive evaluation capabilities for AI agents.
Example
use praisonai::eval::{AccuracyEvaluator, EvaluationScore};
let evaluator = AccuracyEvaluator::new()
.input("What is 2+2?")
.expected("4")
.build();
let result = evaluator.run().await?;
println!("Score: {}", result.score);Import
use praisonai::eval::*;Classes
Score from an evaluation.
PerformanceMetricsPerformance metrics from an evaluation.
ToolCallResultResult of a tool call during evaluation.
CriteriaScoreScore for a specific criterion.
AccuracyResultResult from an accuracy evaluation.
PerformanceResultResult from a performance evaluation.
ReliabilityResultResult from a reliability evaluation.
CriteriaResultResult from a criteria evaluation.
EvaluatorConfigConfiguration for evaluators.
AccuracyEvaluatorEvaluator for accuracy (comparing output to expected).
AccuracyEvaluatorBuilderBuilder for AccuracyEvaluator.
PerformanceEvaluatorEvaluator for performance metrics.
PerformanceEvaluatorBuilderBuilder for PerformanceEvaluator.
ReliabilityEvaluatorEvaluator for reliability (tool call verification).
ReliabilityEvaluatorBuilderBuilder for ReliabilityEvaluator.
CriteriaEvaluatorEvaluator for custom criteria.
CriteriaEvaluatorBuilderBuilder for CriteriaEvaluator.
JudgeConfigConfiguration for a judge.
JudgeResultResult from a judge.
JudgeA judge for evaluating outputs.
EvaluatorBase trait for evaluators.