QuestionQ67

VerifiedTesting, Validation, and Troubleshooting

A company uses Amazon Bedrock to implement a Retrieval Augmented Generation (RAG)-based system that provides medical information to users. The company must compare multiple chunking strategies, assess the generation quality of two foundation models (FMs), and enforce quality thresholds for deployment.

Which Amazon Bedrock evaluation configuration meets these requirements?

Explanation

A retrieve-and-generate RAG evaluation measures both retrieval and response-generation performance. Custom precision-at-k can evaluate retrieval effectiveness across chunking strategies, and a custom LLM-as-a-judge metric with a defined 1–5 rating scale produces structured quality scores for comparing both FMs and applying deployment thresholds. Amazon Bedrock supports Anthropic Claude Sonnet models as evaluator models for custom RAG metrics. Evaluate the performance of RAG sources using Amazon Bedrock evaluations Use metrics to understand RAG system performance

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!