QuestionQ42

VerifiedEvaluation, Testing & Optimization

The platform team at Trenova Systems, Inc. must lower per-query cost and p95 latency for a high-volume Claude pipeline without reducing output quality for the core use case.

Which two optimizations directly address both cost and latency at the same time? (Select two.)

Choose two
Explanation

Prompt caching lets repeated calls reuse a static system-prompt prefix, so cached input is billed at a lower rate and avoids reprocessing that prefix. Routing straightforward requests to a smaller, faster model lowers inference cost and response time, while reserving the larger model for complex requests preserves quality where it matters. Increasing output limits, retrieving an entire corpus, or expanding every prompt adds processing or tokens rather than directly reducing both metrics.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!