QuestionQ21

Fundamentals of GenAI

An AI practitioner is creating a prompt for large language models (LLMs) in Amazon Bedrock. The practitioner must ensure that the prompt works across all Amazon Bedrock LLMs.

Which characteristic may vary among the LLMs?

  • A Maximum token count
  • B On-demand inference parameter support
  • C The ability to control model output randomness
  • D Compatibility with Amazon Bedrock Guardrails
Explanation

Amazon Bedrock models can have different maximum generated-response token limits. A prompt and its requested output length must therefore remain within the maximum token count supported by every target model. AWS notes that inference-parameter defaults and valid ranges depend on the model, and maxTokens defaults to the maximum permitted by the selected model.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!