5
$\begingroup$

I'd like to hear your opinions on the following:

  • What parameters would you report when estimating different likelihood based regression? AIC, BIC, Pseudo $R^2$?
  • What is the standard to report?

It should be a parameter which answers the question of how good the specified model is.

Improve this question
$\endgroup$
4
  • 1
    $\begingroup$ Probably depends heavily on the field and journal you are interested in. $\endgroup$
    – Sacha Epskamp
    Commented Jun 7, 2011 at 19:55
  • 2
    $\begingroup$ See stats.stackexchange.com/q/577/159 for some discussion. $\endgroup$
    – Rob Hyndman
    Commented Jun 8, 2011 at 4:41
  • $\begingroup$ Nice link, @RobHyndman, here's a nice discussion on pseudo $R^2$, : stats.stackexchange.com/questions/3559/… $\endgroup$
    – gung - Reinstate Monica
    Commented Nov 14, 2011 at 4:49
  • $\begingroup$ None of the measures mentioned is a measure of goodness of fit. They are mainly measures of predictive discrimination. I tend to report pseudo $R^2$ and Somers' $D_{xy}$ rank correlation between predicted and observed $Y$, which is a simple translation of $c$-index (ROC area) when $Y$ is binary. $\endgroup$
    – Frank Harrell
    Commented Dec 15, 2011 at 14:05

2 Answers 2

Reset to default
2
$\begingroup$

Which is "standard" must depend on field. Like @EpiGrad , I often see none reported.

But in model building, I usually find that the various measures agree; when they do not, it is worth thinking about the models. Indeed, it is always worth thinking about the models - hopefully with a subject matter expert.

A model which makes no substantive sense is a bad model, regardless of any statistical measure; a model which leads to insight is a good model.

Improve this answer
$\endgroup$
2
  • $\begingroup$ You might consider using either italics or bold face to set off particular words of emphasis. ALL CAPS just doesn't look pleasant (to my eyes, at least). $\endgroup$
    – cardinal
    Commented Nov 14, 2011 at 0:42
  • $\begingroup$ I have gone ahead and made the edits. I hope you don't mind. Cheers. :) $\endgroup$
    – cardinal
    Commented Nov 14, 2011 at 21:41
1
$\begingroup$

Frankly, in my field, I never see measures of model fit reported. They tend to get used as internal diagnostics, with the assumption that by the time you've reached the point where you're trying to report model results, you've properly tuned your model.

In essence, we're interested in estimates of effect - if your model fits terribly, why are you (hypothetical you, not @author) trying to publish it?

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.