QuestionQ58

VerifiedFoundation Model Integration, Data Management, and Compliance

A global company is developing an AI assistant that uses RAG. The company requires the AI assistant to deliver near-real-time, low-latency performance. The AI assistant must serve multiple geographic areas. The company’s customers will use proprietary data with the AI assistant, and that proprietary data must not leave the company’s immediate geographic area.

Which solution will satisfy these requirements?

Explanation

Amazon Bedrock cross-Region inference profiles can automatically route prompts and responses to destination Regions, so they cannot ensure that proprietary data remains in its immediate local area. Deploying the knowledge base, vector database, and EC2-hosted LLM in each applicable AWS Local Zone keeps processing local for low latency and data-locality requirements. Amazon RDS supports placing DB instances in Local Zone subnets, and S3 Express One Zone provides low-latency storage local to compute.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!