D-DS-FN-23: Data Science Foundations

By Dell · Question Mode

QuestionQ1

Advanced Analytics - Theory, Application, and Interpretation of Results for Eight Methods

A decision tree is being constructed. An internal node is being assessed for partitioning on variables A and B. The internal node has an entropy of 0.8, and each variable has the following entropy:

  • Variable A: 0.5
  • Variable B: 0.4

Which variable will partition the data, and what is its information gain?

Explanation

Information gain is the parent-node entropy minus the entropy after the split. Variable B produces an information gain of 0.8 − 0.4 = 0.4, which is greater than the gain from Variable A.

Community Discussion

No comments yet. Be the first to start the discussion!