New answers tagged expected-value
2
votes
Accepted
Expectations of estimators
Jensen's Inequality for random variables is involved here.
If, say, $X$ is a random variable and a function $f$ is convex then
$$\mathbb E[f(X)] \geq f\left(\mathbb E[X]\right).$$
The reverse ...
2
votes
Expectations of estimators
Specifically, why is the expected value of a ratio not equal to the ratio of expected values?
Suppose
$$
(X,Y) = \begin{cases} (1,1) \\
(1,2) \\
(2,1) \\ (2,2) \end{cases} \text{all with equal ...
0
votes
Proof of $\mathbb{E} (|X-Y|) = 0 \implies X^2 = Y^2$
If you are allowed to use the standard fact that a measurable function vanishes almost everywhere iff the Lebesgue integral of its absolute value vanishes, then you can write
$0 = \mathbb E(|X-Y|) = \...
1
vote
Bayes Predictor for linear regression with square loss and expected value properties
For the squared error loss $l(\theta, a)=(\theta-a)^2$, the Bayes estimate of $\theta$ after $X=x$ is observed is given by the value of $a$ which minimises the expected squared error loss $\mathbb{E}[(...
2
votes
(More complete) proof the Fisher information is additive
\begin{align}
\mathbb E\left[\frac{\partial}{\partial\theta}\log f(X_1)
\frac{\partial}{\partial\theta}\log f(X_2)\right] &=
\mathbb E\left[\frac{\partial}{\partial\theta}\log f(X_1)\right]
\...
4
votes
Accepted
(More complete) proof the Fisher information is additive
One has to utilize the regularity conditions which ensure that the family is stable meaning the gradient and hessian of the likelihood function are uniformly bounded in a nbd of $\theta$ by integrable ...
Top 50 recent answers are included
Related Tags
expected-value × 2361probability × 594
self-study × 319
random-variable × 245
variance × 223
mathematical-statistics × 219
distributions × 215
normal-distribution × 215
conditional-expectation × 199
mean × 84
conditional-probability × 73
covariance × 73
regression × 70
moments × 70
integral × 64
machine-learning × 47
density-function × 47
independence × 47
uniform-distribution × 47
sampling × 42
binomial-distribution × 42
bayesian × 38
stochastic-processes × 38
maximum-likelihood × 36
correlation × 35