QuestionQ23

Fundamentals of GenAI

A company wants to build a generative AI application by using Amazon Bedrock and needs to choose a foundation model (FM). The company wants to know how much information can fit into one prompt.

Which consideration will inform the company's decision?

  • A Temperature
  • B Context window
  • C Batch size
  • D Model size
Explanation

The context window defines the maximum number of tokens (input and output combined) a foundation model can process in a single prompt. This directly determines how much information can fit into one prompt. Temperature controls output randomness, batch size relates to throughput efficiency, and model size refers to parameter count—none of these affect individual prompt length limits.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!