AWS Certified Generative AI Developer - Professional AIP-C01

By Amazon · Question Mode

QuestionQ42

Operational Efficiency and Optimization for GenAI Applications

A company has deployed an AI assistant as a React application that uses AWS Amplify, an AWS AppSync GraphQL API, and Amazon Bedrock Knowledge Bases. The application uses the GraphQL API to invoke the Amazon Bedrock RetrieveAndGenerate API for knowledge base interactions. The company configures an AWS Lambda resolver with the RequestResponse invocation type.

Application users report frequent timeouts and slow response times. Users report these issues more often for complex questions that require longer processing.

The company needs a solution to resolve these performance issues and improve the user experience.

Which solution will meet these requirements?

Explanation

AWS Amplify AI Kit supports streamed LLM responses for React applications. Its Lambda integration calls Amazon Bedrock by using a streaming request and sends response chunks to the browser through an AWS AppSync WebSocket connection, where the client can render them incrementally. This avoids waiting for the entire long-running generation required by a synchronous RequestResponse resolver.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!