QuestionQ111
VerifiedTesting, Validation, and TroubleshootingA company operates a customer service application that leverages Amazon Bedrock to generate personalized responses to customer inquiries. The company wants to set up a quality assurance process to evaluate how effective its prompts are and how well its model configurations perform across updates. This process needs to:
- Automatically compare outputs produced by multiple prompt templates
- Detect issues with response quality
- Provide quantitative metrics for evaluation
- Allow human reviewers to submit feedback on the generated responses
- Prevent any configuration that does not meet a predefined quality threshold from being deployed
Which solution will meet these requirements?
Community Discussion