New answers tagged maximum-entropy
0
votes
Intuition for the uniform distribution having the maximum entropy
Consider the case of a discrete distribution with two possible outcomes. We have a function
f(x,y)=x*log(1/x)+y*log(1/y)
and we are interested in it's values only ...
Top 50 recent answers are included
Related Tags
maximum-entropy × 172entropy × 51
information-theory × 29
distributions × 21
machine-learning × 18
probability × 16
bayesian × 16
classification × 9
maximum-likelihood × 8
density-function × 8
mathematical-statistics × 7
prior × 7
intuition × 7
self-study × 6
natural-language × 6
exponential-family × 6
normal-distribution × 5
estimation × 5
moments × 5
mutual-information × 5
time-series × 4
logistic × 4
modeling × 4
joint-distribution × 4
bernoulli-distribution × 4