Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

When splitting attributes while constructing a decision tree, i can use information gain or information gain ratio to try and determine the best value to split the tree on.

  • I'd use information gain when I have smaller numbers of distinct values (mostly nominal and ordinal values that are not continuous)
  • I'd use information gain ratio for attributes which have large numbers of distinct values (mainly continuous values)

That said, do I necessarily have to choose one method for use with all attributes across the entire tree?

My gut feeling is no, because information gain or information gain ratio for comparison to other attributes is not a relevant comparison; it's only relevant for comparison to a different value of the same attribute for the purposes of producing a split.

I'm thinking that one might be able to go so far as to swap them for different splits in the tree, depending on the training data. If the subset of values for that attribute is small compared to previous splits where the distinct values were large, one could use the value that's more biased to producing a more useful result.

share|improve this question
I've added the entropy tag because entropy is a fundamental part of information gain (granted, I believe Gini impurity could be used too). If it's inappropriate to the question feel free to edit it out. I would have added information-gain but it doesn't seem to exist and I currently don't have the rep to create it. – casperOne Sep 1 '12 at 14:17
I think there are two related questions here - 1) Is this a legitimate thing to do and 2) Is there software to do it. Did you want to ask both, or just one? – Peter Flom Sep 1 '12 at 14:19
@PeterFlom Not concerned with the second question, I'm writing my own software. I simply want to know if it's a legitimate thing to do. If it reads as "is there software that does this" then please let me know where I can improve the question to remove that impression, as that is a shopping list question/recommendation question and not a good fit for any of the Stack Exchange sites (it's closed as "Not Constructive"). – casperOne Sep 2 '12 at 1:15

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.