QuestionQ5

Operational Efficiency and Optimization for GenAI Applications

An enterprise application uses an Amazon Bedrock foundation model (FM) to process and analyze technical documents of 50 to 200 pages. Users experience inconsistent responses and truncated outputs when processing documents that exceed the FM's context-window limits.

Which solution will solve this problem?

Explanation

Amazon Bedrock Knowledge Bases hierarchical chunking indexes smaller child chunks for precise retrieval and replaces retrieved child chunks with their broader parent chunks, providing the FM with more comprehensive relevant context while keeping each inference within its context window. Bedrock semantic chunking does not support a buffer size of 3; its valid buffer-size range is 0–1.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!