AWS Certified Generative AI Developer - Professional AIP-C01

By Amazon · Question Mode

QuestionQ30

Operational Efficiency and Optimization for GenAI Applications

A company is developing a serverless application that uses AWS Lambda functions to help students worldwide summarize notes. The application uses Anthropic Claude through Amazon Bedrock. The company has noticed that most traffic occurs during evening hours in each time zone. Users report throttling errors at peak usage times in their respective time zones.

The company must resolve the throttling issues while ensuring the application operates continuously. The solution must preserve application performance quality and must not incur a fixed hourly cost during periods of low traffic.

Which solution meets these requirements?

Explanation

Amazon Bedrock cross-Region inference distributes on-demand requests across capacity in multiple AWS Regions, helping absorb unplanned traffic bursts and improve availability without purchasing continuously billed provisioned throughput. Amazon Bedrock runtime metrics include Invocations, InputTokenCount, OutputTokenCount, and InvocationThrottles, which provide the needed visibility into usage and throttling.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!