QuestionQ15

VerifiedSnowflake Gen AI & LLM Functions

How can costs that are directly associated with invoking the Snowflake Cortex COMPLETE function be minimized?

Choose two
Explanation

Cortex COMPLETE bills for processed tokens, including output tokens; max_tokens caps the number of output tokens generated and can therefore reduce cost. Choosing a smaller LLM with fewer parameters can also reduce the model’s inference cost. The max_tokens setting does not limit input tokens, and virtual warehouse sizing is not a direct control for Cortex COMPLETE inference charges.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!