2
$\begingroup$

I am wondering how to calculate information gain using mutual information. With the help of python's sckit-learn, i have calculated mutual information between two features directly, but there is no library which can calculate information gain. Could you please describe the way to calculate Information gain. Thank you.

Improve this question
$\endgroup$
1
  • 1
    $\begingroup$ Mutual Information and Information gain refer to the same thing (or could potentially refer to the same thing). $I(X;Y) = H(X) - H(X|Y)$ $\endgroup$
    – lonel
    Commented Nov 24, 2018 at 3:20

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.