QuestionQ102
VerifiedOperational Efficiency and Optimization for GenAI ApplicationsA media company is building an AI-powered content moderation system using Amazon Bedrock. The system first classifies text using a small, low-latency model, then escalates requests whose confidence score is below 0.65 to a larger, more expensive model.
The solution must meet the following requirements:
- Respond in near real time for high-confidence results.
- Process low-confidence requests asynchronously.
- Scale to handle sudden spikes in demand.
- Optimize costs by invoking the larger model only when required.
- Use decoupled components to achieve high resiliency.
Which solution will meet these requirements?
Community Discussion