Why can't likelihood ratio tests be used for non-nested models?

More specifically, why do the likelihood ratio tests have asymptotically a $\chi^2$ distribution if the models are nested, but this is no longer the case for the not-nested models? I understand that this follows from the Wilks' theorem, but unfortunately, I don't understand its proof.

Well, I can give a non-rigorous answer from a non-statistician. The Likelihood ratio method relies on the fact that the denominator max likelihood gives a results always at least as good as the numerator max likelihood because the numerator Hypothesis corresponds to a subset of the denominator hypothesis. As a result, ratio is always between 0 and 1.

If you would have non-nested hypothesis (like testing 2 different distributions), likelihood ratio could be > 1 => -1 * log likehood ratio could be < 0 => it is certainly not a chi2 distribution.

• Yeah, that's a point. It is not a satisfactory explanation, though. What about $|D|$? Just to define as the null model the one which has lower likelihood? As in -- we always ask whether the better model is significantly better? – January Sep 19 '13 at 8:27
• Sorry but what do you mean by $|D|$ ? – Mr Renard Sep 19 '13 at 8:55
• The test statistic for the likelihood ratio test, $D=-2\cdot log( \frac{\mathcal{L} (\Theta_0)}{\mathcal{L} (\Theta_a)})$ – January Sep 19 '13 at 8:56
• Ok thanks, so what is exactly your question about D ? – Mr Renard Sep 19 '13 at 8:59
• My question: if I define $D'=|D|$ (or, in other words, we always test the model with the lower likelihood against the model with the higher likelihood), wouldn't $D'$ have a $\chi^2$ distribution? – January Sep 20 '13 at 8:54

In order to undertake hypothesis testing you need to express your research hypothesis as a null and alternative hypothesis. The null hypothesis and alternative hypothesis are statements regarding the differences or effects that occur in the population. You will use your sample to test which statement (i.e., the null hypothesis or alternative hypothesis) is most likely (although technically, you test the evidence against the null hypothesis).

The null hypothesis is essentially the "devil's advocate" position. That is, it assumes that whatever you are trying to prove did not happen (hint: it usually states that something equals zero).

Looking here, we can find this text:

Hypothesis testing is an essential procedure in statistics. A hypothesis test evaluates two mutually exclusive statements about a population to determine which statement is best supported by the sample data. When we say that a finding is statistically significant, it’s thanks to a hypothesis test.