New answers tagged fisher-information
0
votes
How (or can) you formulate the Fisher information matrix in terms of a loss function, specifically cross-entropy loss?
The definition of the paper you refer to is
I think the answer to your question comes from the definition of
$L(x,y;\mathbb{1})$. To me, this looks like the loss over a single example for which only ...
5
votes
What is the information in an exact p-value?
The Fisher information matrix* is defined as the variance of the score
$$I(\theta) = E\left[\left(\frac{d}{d\theta} \log f(X|\theta)\right)^2\right]$$
where $\theta$ is the parameter value of a ...
3
votes
What is the information in an exact p-value?
Michael Lew's answer(s) are exactly right, and I believe I can enhance them by describing the insight that finally allowed me to see that. A valid test statistic is an ancillary statistic, meaning its ...
Top 50 recent answers are included
Related Tags
fisher-information × 327maximum-likelihood × 90
mathematical-statistics × 68
self-study × 39
likelihood × 35
estimation × 33
inference × 21
information-theory × 20
variance × 17
hessian × 16
bayesian × 15
normal-distribution × 15
covariance-matrix × 15
probability × 14
expected-value × 12
asymptotics × 12
estimators × 11
confidence-interval × 9
standard-error × 9
matrix × 9
exponential-family × 9
hypothesis-testing × 8
distributions × 8
optimization × 8
covariance × 8