CCAR-P: Claude Certified Architect — Professional

Question

You operate an interactive assistant where per-turn latency is the primary performance constraint. Quality on routine turns is already acceptable.

Which configuration change most directly improves latency without disproportionately harming quality?

Explanation

Retrieving only the top-k passages that historically supply the needed information reduces retrieval work and the prompt context processed on each turn, while preserving routine-answer quality. Caching stable system-prompt content avoids reprocessing an unchanged prefix. Retrieval adds compute and round trips, and preserving cached context improves cache utilization.

Learn more

CCAR-P: Claude Certified Architect — Professional

AstroTutor

Notes

Readiness

QuestionQ4

Community Discussion