QuestionQ39VerifiedCopy linkReport a problemAsk AstroTutorSave questionWhich evaluator is best suited to verifying a boolean output that must be strictly true?AJSON similarity, because it tolerates structure equivalence rather than single-value strict equality.BExact match, because it enforces a strict equality check on the boolean value without ambiguity.CLLM-as-a-Judge, because it scores semantic similarity rather than strict boolean equality requirements.DTrajectory evaluator, because it reviews behavior history instead of enforcing exact output equality.Show AnswerAnswerExplanationAn exact match evaluator compares the actual boolean value with the expected value, true, and passes only when they match. This provides a deterministic check rather than a semantic or behavioral assessment. (palantir.com)Learn morePalantir AIP Evals: Create an evaluation suiteShow comments0Show commentsCommunity DiscussionNo comments yet. Be the first to start the discussion!
Community Discussion