New answers tagged mutual-information
0
votes
Signal-to-noise ratio in predictive modeling and machine learning
Probably the easiest to digest example is a simple detection task.
Say you make a measurement $X_m$ of some system and you want to detect whether or not a DC (constant) signal with amplitude $\mu$ is ...
0
votes
Information Value Definition on Siddiqui "Credit Risk Scorecards" Book
Mutual Information (sometimes called Information Gain) is a decrease in information entropy of one random variable when another is known. It measures dependency (not only linear) between random ...
Top 50 recent answers are included
Related Tags
mutual-information × 388information-theory × 163
entropy × 89
probability × 43
correlation × 39
machine-learning × 36
feature-selection × 32
kullback-leibler × 19
independence × 13
r × 12
clustering × 12
conditional-probability × 12
random-variable × 11
mathematical-statistics × 10
python × 10
self-study × 9
bayesian × 9
classification × 9
natural-language × 9
time-series × 8
normal-distribution × 8
scikit-learn × 8
estimation × 7
continuous-data × 7
regression × 6