QuestionQ24

AI Safety, Security, and Governance

A specialty coffee company has a mobile app that uses Amazon Bedrock and a three-stage prompt chain to generate personalized coffee roast profiles. The prompt chain converts user inputs into structured metadata, retrieves relevant coffee-roast logs, and produces a personalized roast recommendation for each customer.

Users across multiple AWS Regions report inconsistent roast recommendations for identical inputs, slow inference in the retrieval step, and unsafe recommendations, such as brewing at excessively high temperatures. The company must improve output stability for repeated inputs, application performance, and the safety of the application's outputs. The updated solution must ensure 99.5% output consistency for identical inputs and inference latency of less than 1 second. The solution must also block unsafe or hallucinated recommendations by using validated safety controls.

Which solution will meet these requirements?

Explanation

Amazon Bedrock Provisioned Throughput supplies dedicated model capacity for more predictable inference performance. Amazon Bedrock Guardrails can block undesirable recommendations through denied-topic policies and can detect or filter hallucinated responses with contextual grounding checks. Amazon Bedrock Prompt Management supports versioned prompt configurations, enabling a consistent approved prompt version to be deployed across application environments.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!