CCAR-P: Claude Certified Architect — Professional

By Anthropic · Question Mode

QuestionQ32

VerifiedEvaluation, Testing & Optimization

A Claude-based research assistant starts generating responses that confidently contradict its retrieved source documents, even though the retrieval pipeline has not changed.

Which two diagnostic actions most directly identify the root cause of this behavior? (Select two.)

Choose two
Explanation

Reproducing the behavior with the previous model version can isolate a model-version or model-routing mismatch when retrieval has remained unchanged. Reviewing the system prompt verifies that the instructions requiring answers to be grounded in retrieved content and constrained by citations have not been removed or weakened. Claude model updates can change instruction-following behavior, so Anthropic recommends testing applications when changing models.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!