NCA-GENL: Generative AI and LLMsDemo

By NVIDIA · Question Mode

QuestionQ58

Core Machine Learning and AI Knowledge

In neural networks, what issue does the vanishing-gradient problem refer to?

  • A The issue of gradients becoming too large during backpropagation, leading to unstable training.
  • B The problem of underfitting in neural networks, where the model fails to capture the underlying patterns in the data.
  • C The issue of gradients becoming too small during backpropagation, resulting in slow convergence or stagnation of the training process.
  • D The problem of overfitting in neural networks, where the model performs well on the training data but poorly on new, unseen data.
Explanation

Vanishing gradients are gradients that become extremely small during backpropagation. This produces negligible weight updates, particularly in earlier layers, causing training to converge very slowly or stall.

Community Discussion

No comments yet. Be the first to start the discussion!