QuestionQ39

Eval, Testing, and Debugging

A Claude application sometimes declines to answer questions that should be within scope, including questions it has previously answered correctly. You want to investigate this behavior. What should be the first step of the investigation?

Explanation

Request traces expose the complete context of each refusal, allowing the specific trigger—such as the input pattern, system-prompt content, or other request context—to be identified before making changes or performing aggregate analysis. Claude identifies safety refusals with a refusal stop reason, so request-level inspection is the appropriate starting point for diagnosing them.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!