QuestionQ145Verified/Process AnalysisCopy linkReport a problemAsk AstroTutorSave questionWhat best characterizes an evaluation in the context of assessing an agent’s performance?AAn evaluation is a pair consisting of an input and an assertion (or evaluator) made on the agent’s output.BAn evaluation is a process of debugging and re-running failed evaluation runs.CAn evaluation is a numeric score on a scale from 0 to 100, measuring agent performance based on assertions.DAn evaluation is a collection of evaluators grouped logically for testing the agent’s performance.Show AnswerAnswerExplanationAn evaluation supplies an input to the agent and checks the resulting output against an assertion or evaluator. The assertion defines the expected, verifiable behavior, while any score is an outcome produced by that assessment. Microsoft’s agent-evaluation guidance describes a test case as a prompt with expected behavior and assertions, whose response is checked by a grader.Learn moreAgent evaluation overview — Microsoft LearnShow comments0Show commentsCommunity DiscussionNo comments yet. Be the first to start the discussion!
Community Discussion