QuestionQ58

VerifiedGovernance, Safety & Risk Management

A research-summarization assistant has been in production for six months. A user reports that a generated summary included a fabricated citation. The product team asks whether the incident needs architectural action or is an isolated occurrence.

Which two Diligence-competency actions should you take? Each correct answer represents part of the solution. (Select two.)

Choose two
Explanation

Assessing a sample of recent summaries establishes whether citation fabrication is a broader production-quality problem and provides evidence for deciding its scope. Reviewing the generation pipeline for citation-grounding controls identifies whether the system has effective mechanisms to tie citations to supporting sources and expose a systemic architectural gap. NIST describes systematic evaluation of factual grounding and automated citation evaluation, while Microsoft recommends validation and monitoring of retrieval and grounding components.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!