QuestionQ93VerifiedCopy linkReport a problemAsk AstroTutorSave questionWhat is the primary risk of using strict assertions in creative or generative tasks?AIt guarantees higher evaluation scores for all runsBIt reduces the need for evaluator conditions in datasetsCIt ensures outputs are always consistent and predictableDIt may incorrectly flag valid outputs as failures due to minor variationsShow AnswerAnswerExplanationCreative and generative tasks can have multiple valid outputs. Strict assertions, such as exact-match checks, may incorrectly mark an output as a failure because its wording or format differs from the expected response. (learn.microsoft.com)Learn moreChoose evaluation methodsShow comments0Show commentsCommunity DiscussionNo comments yet. Be the first to start the discussion!
Community Discussion