AWS Certified Generative AI Developer - Professional AIP-C01

By Amazon · Question Mode

QuestionQ52

Testing, Validation, and Troubleshooting

A medical company uses Amazon Bedrock to run a clinical-documentation summarization system. The system generates inconsistent summaries when it processes complex clinical documents, although it performed well with simple clinical documents.

The company requires a solution that diagnoses the inconsistencies, compares prompt performance against established metrics, and preserves historical records of prompt versions.

Which solution meets these requirements?

Explanation

Version-controlling prompts alongside a test suite of representative complex clinical documents enables reproducible investigation of the failures. Automated tests can apply defined quantitative metrics to each prompt version, compare results consistently, and retain a historical record of both prompt changes and observed performance. Amazon Bedrock documentation likewise supports prompt versioning and emphasizes using evaluation data and metrics to assess prompt performance.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!