CCAR-P: Claude Certified Architect — Professional

By Anthropic · Question Mode

QuestionQ26

VerifiedEvaluation, Testing & Optimization

You are evaluating a Claude-based system whose primary risk is undetected quality drift in safety-relevant outputs after a model-version upgrade.

Which assessment activity most directly mitigates this risk?

Explanation

A stable adversarial evaluation set, scored and recorded by model version before promotion, provides a controlled regression comparison that can reveal safety-quality drift introduced by an upgrade. Anthropic recommends thoroughly testing applications with newer models before migrating to them.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!