QuestionQ48

VerifiedEvaluating and deploying agentic workflows

You are assessing a multitool customer support agent. In CI/CD, you find that changes in live API data cause unpredictable test failures, making it difficult to detect regressions in reasoning trajectories or tool selection. You need to improve evaluation reliability in CI/CD and accurately validate the agent’s behavior independently of shifts in live backend data.

What should you do?

Explanation

Mock tool cassettes replay fixed API responses, reducing failures caused by changes in live backend data. Trajectory metrics compare the agent’s tool calls with a reference trajectory, helping detect regressions in tool selection and call order. (docs.cloud.google.com)

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!