QuestionQ97
VerifiedTesting, Validation, and TroubleshootingA company operates a generative AI (GenAI) application that uses Amazon Bedrock to deliver real-time responses to customer queries. The company has observed intermittent API-call failures to foundation models (FMs) during periods of peak traffic.
The company requires a solution that handles transient errors and delivers detailed observability into FM performance. The solution must prevent cascading failures during throttling events and provide distributed tracing across service boundaries to identify contributors to latency. The solution must also support correlating performance issues with specific FM characteristics.
Which solution satisfies these requirements?
Community Discussion