9
$\begingroup$

I am currently working on trying to implement a method used in a popular paper titled "I Just Ran Two Million Regressions". The basic idea behind it is that there are certain cases where it is not obvious what controls should be included in the model. One thing that you can do in such a case is to randomly draw controls, run millions of different regressions and then see how your variable of interest reacted. If it generally has the same sign in all specifications then we can consider it more robust than a variable whose sign always changes.

Most of the paper is very clear. However, the paper weights all those different regressions in the following manner: The integrated likelihood of the given specification is divided by the sum of all the integrated likelihoods for all the specifications.

The trouble that I am having is that I am not sure how the integrated likelihood relates to the OLS regressions that I would like to run (in Stata). Googling topics such as "stata integrated likelihood" has been a dead end as I keep on running into things like mixed effects logistic regression. I confess that these models are too complex for me to grasp.

My current work around is that that there are different weighting schemes used in the literature that I do (kind-of) understand. For example, it is possible to weight each regression based on the likelihood ratio index. There is even an R package that uses the lri as weights. Naturally though, I would like to also implement the original one.

Any advice?

Paper Link: http://down.cenet.org.cn/upfile/34/2009112141315178.pdf

Improve this question
$\endgroup$
3
  • 1
    $\begingroup$ This thread may address some of your concerns... stats.stackexchange.com/questions/215154/… $\endgroup$
    – user78229
    Commented Jul 17, 2016 at 1:49
  • 1
    $\begingroup$ I once wrote a function in MATLAB replicating Sala-i-Martin's result (which, by the way, are not really state of the art in model selection), see dropbox.com/s/mqa7qvhn7w5pkag/…. The integrated likelihood (not sure what you are exactly referring to) probably just is the exponentiated log-likelihood. $\endgroup$
    – Christoph Hanck
    Commented Jul 18, 2016 at 5:45
  • $\begingroup$ Thanks! I am referring to equation 4 on page 179. It states "Where the weights are proportional to the (integrated) likelihoods" $\endgroup$
    – NikolaiB
    Commented Jul 18, 2016 at 16:36

1 Answer 1

Reset to default
1
$\begingroup$

For OLS, you can still compute the likelihood function (the exponentiated log likelihood, as Christoph Hanck mentions in the comment). It is just the good old $L_i = \prod_i (2\pi \sigma^2)^{-.5} \exp(-.5 (y_i - x_i\beta)^2)$. Stata stores this as e(ll) after running a regression using regress

Then you construct weights as $w_i = \frac{L_i}{\sum_j L_j}$.

Finally, you construct weighted averages of your regression coefficients using $w_i$ as weights.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.