QuestionQ18

VerifiedFundamentals of GenAI

A company intends to add generative AI capabilities to its application by integrating a large language model (LLM). The LLM responses must be as deterministic and stable as possible.

Which solution fulfills these requirements?

Explanation

Temperature is the inference parameter that controls response randomness. A temperature of 0 minimizes randomness and therefore yields the most deterministic and stable output for the same prompt; instructing the model in prompt text does not provide the same sampling control, while a temperature of 1 increases variation.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!