QuestionQ30

Verified

If evaluation scores vary significantly between runs that use the same evaluation set and configuration, what is the most relevant interpretation?

Explanation

An agent can produce different responses to the same inputs even when the evaluation set and configuration remain unchanged. That variability can affect scores and indicate inconsistent reliability. Evaluator variability can also contribute, so it should be investigated before attributing all score changes to the agent. (learn.microsoft.com)

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!