All Questions
Tagged with communication asymptotics
2 questions
0
votes
0
answers
26
views
What is the non-asymptotic counterpart of the mutual information?
The mutual information of a joint probability distribution $p(x,y)$ tells us, if we send $n$-letter messages with each letter drawn from the marginal distribution $p_X(x)$, that we can use roughly $2^{...
- 393
14
votes
4
answers
4k
views
How does one explain what an unbiased estimator is to a layperson?
Suppose $\hat{\theta}$ is an unbiased estimator for $\theta$. Then of course, $\mathbb{E}[\hat{\theta} \mid \theta] = \theta$.
How does one explain this to a layperson? In the past, what I have said ...
- 5,147