5
votes
Accepted
MLE and non closed-form solutions - how to see or proof it?
Take the standard classical OLS model:
$$ \mathbf{y} = \mathbf{\beta} \mathbf{X} + \epsilon $$
where $\mathbf{\beta}$ is a vector and $\mathbf{X}$ is a matrix. There is a closed form solution for $\...
4
votes
Does the MLE converge in mean-square?
An example of an MLE that converges in probability but not in mean square is the ratio of two binomials. Let $X_n\sim Bin(n,p)$ and $Y_n\sim Bin(n,q)$, then the MLE of $(p,q)$ is $(\bar X_n, \bar Y_n)...
1
vote
Maximum Likelihood Estimation -- why it is used despite being biased in many cases
Unbiasedness is sometimes a very bad thing. An example is found in this paper that I wrote, which appeared in the American Mathematical Monthly.
Hardy, M. (2003). "An Illuminating Counterexample.&...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
maximum-likelihood × 3428estimation × 417
likelihood × 371
self-study × 369
mathematical-statistics × 288
regression × 253
r × 238
bayesian × 210
normal-distribution × 199
optimization × 199
probability × 193
distributions × 166
machine-learning × 161
inference × 132
expectation-maximization × 120
least-squares × 111
estimators × 110
logistic × 102
hypothesis-testing × 99
likelihood-ratio × 97
fisher-information × 96
asymptotics × 91
time-series × 90
confidence-interval × 75
generalized-linear-model × 75