CCDV-F

By Anthropic · Question Mode

QuestionQ36

Eval, Testing, and Debugging

Your team is getting ready to deploy a configuration change that updates several prompt versions across a Claude application used by multiple downstream systems. The change has already been tested in staging, but the team has not evaluated how the prompt change will affect every downstream system that relies on the application's output. What should you do before deploying the change?

Explanation

A prompt-version change can change the output contract, behavior, format, or quality consumed by dependent systems. Each downstream dependency therefore requires an impact assessment before deployment, with coordination from its owners where needed. Anthropic’s evaluation guidance recommends rerunning the full evaluation set after a prompt update to determine how the new prompt affects performance across test cases.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!