AWS Certified Generative AI Developer - Professional AIP-C01

By Amazon · Question Mode

QuestionQ6

Operational Efficiency and Optimization for GenAI Applications

A retail company uses Amazon Bedrock to build a customer service AI assistant. Analysis indicates that 70% of customer inquiries are simple product questions that a smaller model can handle effectively. However, 30% of inquiries are complex return-policy questions requiring advanced reasoning. The company wants to implement a cost-effective model-selection framework that automatically routes customer inquiries to appropriate models according to inquiry complexity. The framework must preserve high customer satisfaction and minimize response latency.

Which solution meets these requirements with the LEAST implementation effort?

Explanation

Amazon Bedrock intelligent prompt routing provides a managed, serverless endpoint that analyzes each incoming prompt, predicts response quality across the selected models, and dynamically sends the request to the model offering the appropriate quality-cost tradeoff. This eliminates custom classification and routing infrastructure while allowing simpler inquiries to use a lower-cost model and complex inquiries to use a more capable model.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!