Calculate Quality Metrics • AI Agent SDK

</div>

This is a method of the Memory class in the memory module.

Calculate quality metrics using LLM

Signature

def calculate_quality_metrics(output: str, expected_output: str, llm: Optional[str], custom_prompt: Optional[str]) -> Dict[str, float]

Parameters

Returns

Uses

• logger.info
• find_spec
• os.getenv
• default_auxiliary_model
• litellm.completion
• OpenAI
• create
• logger.error
• json.loads
• ValueError

Used By

• Task.execute_callback

Source