1
$\begingroup$

I have 4 class and four sets of features extracted from the huge data extracted from Real Time data acquisition system.

Features for each Class.

In above table, there are 4 sets of the features for each class. (C1, C2, C3 and C4). But when calculating information gain, information gain comes same for each features as for all attribute as there is only one value of each attribute for each class.

Can someone please help me in calculating a information gain for building decision tree.

Thanks DDas

|cite|improve this question
$\endgroup$
5
$\begingroup$

In order to use Information Gain, you have to use a sort of sliding feature.

Sliding Splitting for Continuous Variables

In this example, it's using GiniSplit but you can apply Entropy / InformationGain. You essentially sort the data ascending. Then for every distinct value, you create a split (Less than or equal to value vs. greater than value) and calculate the InformationGain on that split. Finally, choose the split that improves InformationGain the most.

|cite|improve this answer
$\endgroup$
  • $\begingroup$ Thank you very much Will J. Your answer solved my problem. I have a great respect for you like people, who take out time from busy schedules and help people in need. $\endgroup$ – Anand Abyankar Jul 19 '15 at 17:11
  • 1
    $\begingroup$ @AnandAbyankar: If this answer solved your problem I would suggest you accept it. $\endgroup$ – usεr11852 says Reinstate Monic Dec 16 '15 at 12:49

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.