NCA-GENL: Generative AI and LLMsDemo

By NVIDIA · Question Mode

QuestionQ42

Core Machine Learning and AI Knowledge

Why is layer normalization significant in transformer architectures?

  • A To enhance the model’s ability to generalize to new data.
  • B To compress the model size for efficient storage.
  • C To stabilize the learning process by adjusting the inputs across the features.
  • D To encode positional information within the sequence.
Explanation

Layer normalization normalizes a token’s activations across its feature dimensions, which stabilizes activation scales and gradients during training and makes optimization more reliable.

Community Discussion

No comments yet. Be the first to start the discussion!