AWS Certified Generative AI Developer - Professional AIP-C01

By Amazon · Question Mode

QuestionQ16

Testing, Validation, and Troubleshooting

A company operates a recommendation system whose applications run on Amazon EC2 instances. The applications make API calls to Amazon Bedrock foundation models (FMs) to analyze customer behavior and produce personalized product recommendations.

The system is having intermittent problems. Some recommendations fail to align with customer preferences. The company requires an observability solution that monitors operational metrics and identifies patterns of operational performance degradation against established baselines. The solution must also produce alerts containing correlation data within 10 minutes when FM behavior departs from expected patterns.

Which solution meets these requirements?

Explanation

Amazon CloudWatch Application Insights monitors applications and underlying EC2 resources, continuously analyzes metrics and logs, detects anomalies based on historical patterns, and correlates metric anomalies with log errors into detected problems. Application-specific recommendation-quality, token-usage, and latency metrics can be published through the CloudWatch embedded metric format, and CloudWatch anomaly detection can identify deviations from established metric baselines. Application Insights can generate events and SNS notifications for detected problems, with dashboards that include correlated diagnostic information.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!