6
$\begingroup$

I thought that the answer was pretty straightforward given that the MLEs possess some strong asymptotic properties, i.e. normality, efficiency and consistency.

But then, I have found that also MME (Methods-of-Moments estimators) can be used to build asymptotic confidence intervals, since they are asymptotically consistent for $\theta$ and their asymptotic distribution can be found using Central Limit Theorem + Delta method.

Thus, how should I answer this question? Are MLEs always better than MMEs or there are some particular cases?

$\endgroup$
2
  • 2
    $\begingroup$ Better in which way? What's your criterion for "good'? $\endgroup$
    – Glen_b
    Jan 20, 2016 at 13:04
  • $\begingroup$ @Glen_b That is a question I found in a past exam of my Stat course. It wasn't explained the measure of "good". I think the professors refers to the properties of the two kind of estimators $\endgroup$
    – PhDing
    Jan 20, 2016 at 13:57

2 Answers 2

5
$\begingroup$

One criticism of method of moments estimators is that they often aren't functions of sufficient statistics, which means they involve discarding useful information from a sample when estimating an unknown parameter.

Take for instance $X_1, \ldots , X_n \sim$ uniform$[0, \theta]$ and the goal is estimation of $\theta$. Since $\text{E}(X_i) = \theta / 2$ a valid method of moments estimator is $\hat{\theta} \equiv 2 \bar{X}$. But $\bar{X}$ is not a sufficient statistic, and as a result our estimator can actually yield impossible values for $\theta$ with a sample such as $\{1, 1, 7 \}$. Maximum likelihood estimators on the other hand will be functions of sufficient statistics, and you don't end up with situations like this one. Also, estimators based on sufficient statistics are in general more efficient than those which are not. To see this let $T$ be any estimator of some parameter $\theta$ and $S$ a sufficient statistic for $\theta$. Then

\begin{align*} \text{Var}(T) &= \text{Var}[\text{E}(T \mid S)] + \text{E}[\text{Var}(T \mid S)] \\ &\geq \text{Var}[\text{E}(T \mid S)] \end{align*}

so $\text{E}(T \mid S)$ is at least as good of an estimator as $T$ since they both have the same bias. The importance of sufficiency here is that it guarantees $\text{E}(T \mid S)$ doesn't depend on $\theta$ and hence is an actual estimator.

I also wouldn't put too much emphasis on consistency. Consistency is actually a very weak property and it doesn't mean much without at least knowing something about rates of convergence. It does us no good for instance to have a consistent estimator that requires an effectively infinite sample size before it can be expected to be close to the real value.

$\endgroup$
4
  • $\begingroup$ It's not clear why $\hat \theta_{MOM} = 4$ is "impossible" in your example. Perhaps you meant the sample was {0,1,4} or something like that? $\endgroup$
    – Cliff AB
    Jan 20, 2016 at 22:42
  • $\begingroup$ @dsaxton Thank you. So, what's the added value of having sufficiency principle to hold in constructing asymptotic confidence intervals? $\endgroup$
    – PhDing
    Jan 21, 2016 at 11:14
  • $\begingroup$ @Alessandro I added a bit to my post. Basically you reduce variance by always using sufficient statistics. $\endgroup$
    – dsaxton
    Jan 21, 2016 at 15:57
  • $\begingroup$ @Alessandro ...which translates into narrower confidence intervals. $\endgroup$
    – dsaxton
    Jan 21, 2016 at 18:05
0
$\begingroup$

Although many times we will get the same answer whether we use the MLE or MOM methods, sometimes it can be different, particularly for more complex probability models. In such cases, the MLE-based estimator is often considered the better one. The tradeoff is that finding the maximum likelihood estimator can be more difficult, and sometimes even require computational effort.

(Probability and Statistics for Bioinformatics and Genetics, Course Notes, Paul Maiste, The Johns Hopkins University)

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.