QuestionQ53
VerifiedEvaluating and deploying agentic workflowsYou are evaluating a policy question-answering agent with an Agent Development Kit (ADK) eval set. Each case stores one reference answer, and the ADK eval suite scores responses using the ADK response_match_score criterion. Reviewers have been asked to evaluate the agent’s responses and identify acceptable responses that cite the policy section and provide any exception applicable to the prompt. However, reviewers cannot agree on which answer to store because several substantially different answers are acceptable.
You want ADK evaluations to assign a pass verdict to every response that meets both conditions and a fail verdict to the rest.
What should you do?
Community Discussion