QuestionQ43
VerifiedFoundation Model Integration, Data Management, and ComplianceA financial services company uses multiple foundation models (FMs) through Amazon Bedrock for its generative AI (GenAI) applications. To meet a new regulation governing GenAI use with sensitive financial data, the company requires a token-management solution.
The token-management solution must proactively alert when applications near model-specific token limits. It must also handle more than 5,000 requests per minute and retain token-usage metrics to allocate costs among business units.
Which solution will satisfy these requirements?
Community Discussion