QuestionQ9
Solution DesignYou are assessing an agent that extracts an invoice date from a PDF. You define a deterministic evaluation with the following ground-truth JSON:
\{"invoice_date": "2024-09-01"\}
What logic does the evaluation use?
- A Ask a human to review and rate the date manually.
- B Count how many characters match between output and input.
- C Compare the extracted date string exactly to the expected value in the ground truth.
- D Use a language model to determine if the date looks plausible.
Community Discussion