QuestionQ153

VerifiedUiPath Platform and Automation Components

A banking agent produces account summaries that show the exact balance, recent transactions, and categorized spending amounts (for example, “Groceries: $120.50”). The agent’s evaluation requires outputs to strictly conform to expected numerical values and formats so that financial reports contain no errors. Which evaluator type is most appropriate for this scenario?

Explanation

Deterministic evaluators, such as exact-match checks or JSON similarity comparisons, validate required numeric values and output structure against predefined expected results. This is necessary for financial reporting, where a small difference in a balance, transaction, category amount, or format is an error rather than an acceptable semantic variation. Microsoft Foundry documents deterministic string checks for exact reference matching, while LLM-based evaluators are intended for semantic or subjective assessment.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!