New answers tagged information-theory
0
votes
Joint entropy of multivariate normal distribution less than individual entropy under high correlation
Recall that entropy is a measure for the uncertainty of a probability distribution. Distributions that are more uncertain and thus, observations from that particular distributions are harder to ...
Top 50 recent answers are included
Related Tags
information-theory × 670entropy × 250
mutual-information × 163
probability × 89
kullback-leibler × 78
machine-learning × 58
mathematical-statistics × 50
distributions × 36
bayesian × 30
maximum-entropy × 29
self-study × 22
normal-distribution × 20
fisher-information × 19
cross-entropy × 18
neural-networks × 17
correlation × 17
regression × 16
hypothesis-testing × 16
inference × 16
feature-selection × 16
conditional-probability × 15
references × 14
r × 13
intuition × 13
model-selection × 12