CCDV-F

By Anthropic · Question Mode

QuestionQ37

Applications and Integration

Your Claude application makes a high volume of API calls during business hours and very few calls overnight. The team is concerned about remaining within rate limits at peak hours and wants to understand how the Claude API applies those limits. How should you proceed?

Explanation

The Claude API enforces organization-level limits for requests per minute, input tokens per minute, and output tokens per minute, including over short intervals through a token-bucket mechanism. Applications should identify their applicable limits, keep peak-hour traffic within them, and handle rate-limit responses by waiting and retrying with exponential backoff. A 429 rate-limit response supplies a retry-after header indicating when retrying may succeed.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!