New answers tagged information-theory
0
votes
Intuition for the uniform distribution having the maximum entropy
Consider the case of a discrete distribution with two possible outcomes. We have a function
f(x,y)=x*log(1/x)+y*log(1/y)
and we are interested in it's values only ...
- 141
1
vote
Typical set concept
Intuition of a random variable $X$'s typical set and $X$'s most probable sample sequence possibly not being in that typical set comes from considering both
the typical set as the set of empirically ...
- 456
Top 50 recent answers are included