# The trinity of tests in maximum likelihood: what to do when faced with contradicting conclusions?

The Wald, Likelihood Ratio and Lagrange Multiplier tests in the context of maximum likelihood estimation are asymptotically equivalent. However, for small samples, they tend to diverge quite a bit, and in some cases they result in different conclusions.

How can they be ranked according to how likely they are to reject the null? What to do when the tests have conflicting answers? Can you just pick the one which gives the answer you want or is there a "rule" or "guideline" as to how to proceed?

-
is this, perhaps, just a case where the asymptotic approximations to the [null] distributions of one or more of the three test statistics are not so good? perhaps the results differ because the actual sizes of the tests are different? how large are your sample sizes? –  ronaf Sep 20 '10 at 1:56

I do not know the literature in the area well enough to offer a direct response. However, it seems to me that if the three tests differ then that is an indication that you need further research/data collection in order to definitively answer your question.

You may also want to look at this Google Scholar search

Update in response to your comment:

If collecting additional data is not possible then there is one workaround. Do a simulation which mirrors your data structure, sample size and your proposed model. You can set the parameters to some pre-specified values. Estimate the model using the data generated and then check which one of the three tests points you to the right model. Such a simulation would offer some guidance as to which test to use for your real data. Does that make sense?

-
Are you referring to a particular paper? I imagine I could find an answer to my question if I researched, studied, read a lot, but so could 95% of the questions other people ask here... Also, in some cases, particularly with macroeconomics data (which is my area), there is no more data to be collected. Data is scarce (the number of observations, I mean), and you just have to live with it. There is no "get more data" solution. I was hoping someone here would know the topic, but it doesn't seem like. Maybe once the website is opened to the general public? –  Vivi Jul 21 '10 at 20:07
I suspect the answer to your question will be domain/model specific and hence I am not sure I can recommend a specific paper. –  user28 Jul 22 '10 at 1:19
Sorry for the late reply. I like your suggestion of simulation. That is not really easy, though. The truth is, what I see in practice is that researchers just do the test that is computationally easier or that give them the result they want. –  Vivi Jul 26 '10 at 7:41