QuestionQ20

Securing AI systems

A company deploys a large language model (LLM) in an application to monitor for a potential denial-of-service attack. Which of the following should the company use to measure LLM utilization?

Explanation

LLM utilization is measured in tokens processed. Tokens represent the units of text consumed as input and generated as output, and are commonly used to quantify model usage.

Community Discussion

No comments yet. Be the first to start the discussion!