QuestionQ15

Snowflake Gen AI & LLM Functions

How can costs that are directly associated with invoking the Snowflake Cortex COMPLETE function be minimized?

Choose two
  • A Set max_tokens to limit the number of input tokens.
  • B Set max_tokens to limit the number of output tokens in the response.
  • C Reduce the size of the virtual warehouse used to run the function.
  • D Use an LLM that has more parameters than the current LLM being used.
  • E Use an LLM that has fewer parameters than the current LLM being used.
Explanation

Cortex COMPLETE bills for processed tokens, including output tokens; max_tokens caps the number of output tokens generated and can therefore reduce cost. Choosing a smaller LLM with fewer parameters can also reduce the model’s inference cost. The max_tokens setting does not limit input tokens, and virtual warehouse sizing is not a direct control for Cortex COMPLETE inference charges.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!