QuestionQ72

VerifiedOperational Efficiency and Optimization for GenAI Applications

A financial services company is building a generative AI (GenAI) application for both premium and standard customers. The application uses AWS Lambda functions behind an Amazon API Gateway REST API to process requests. The company must dynamically switch between AI models according to each user's customer tier. The company also wants to conduct A/B testing for new features without redeploying code. The company must validate model parameters, such as temperature and maximum token limits, before applying changes.

Which solution meets these requirements with the LEAST operational overhead?

Explanation

AWS AppConfig supports feature flags, including multi-variant flags that evaluate caller context against rules to return different configuration values for customer tiers or A/B test cohorts. AWS AppConfig validators support JSON Schema and Lambda validation, preventing deployment of invalid configuration data. The AWS AppConfig Agent Lambda extension retrieves and locally caches configuration, reducing application-side configuration retrieval and management work.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!