QuestionQ129

VerifiedOperational Efficiency and Optimization for GenAI Applications

A global company operates an AI-powered document-processing pipeline that uses Amazon Bedrock to summarize text documents. During peak-traffic periods, the pipeline occasionally times out, causing service degradation.

The company requires a solution that detects when error rates exceed 10% in any 60-second window. When that error-rate threshold is exceeded, the solution must switch to an alternate processing path. It must automatically return to normal Amazon Bedrock processing when the pipeline recovers. The company must ensure that all documents are processed within 15 minutes.

Which solution meets these requirements?

Explanation

A circuit breaker tracks service failures over the required evaluation interval and opens when the configured failure-rate threshold is exceeded, directing work to a fallback path. A shared DynamoDB state store allows Step Functions workflows to consistently apply that state across processing jobs. The circuit can automatically transition back to normal processing after successful recovery checks or expiry of the open-state interval. AWS Prescriptive Guidance describes implementing a circuit breaker with Step Functions and DynamoDB, including circuit status tracking and automatic restoration after the service becomes available.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!