34
$\begingroup$

This looks like a similar question and didn't get many responses.

Omitting tests such as Cook's D, and just looking at residuals as a group, I am interested in how others use residuals when assessing goodness-of-fit. I use the raw residuals:

  1. in a QQ-plot, for assessing normality
  2. in a scatterplot of $y$ versus residuals, for eyeball check of (a) hetereoscedasticity and (b) serial autocorrelation.

For plotting $y$ versus residuals to examine the values for $y$ where outliers may occur, I prefer to use the studentized residuals. The reason for my preference is that it allows easy viewing of which residuals at which $y$-values are problematic, although standardised residuals provide an extremely similar result. My theory on which is used is that it depends on which university one went to.

Is this similar to how others use residuals? Do others use this number of graphs in combination with summary statistics?

Improve this question
$\endgroup$
7
  • 4
    $\begingroup$ Studentized residuals are udoubtedly better in detecting outliers, and, maybe, a little bit better in heteroscedasticity inspection. For other purposes, it makes no difference for me what residuals to use. $\endgroup$
    – ttnphns
    Feb 12, 2012 at 6:04
  • $\begingroup$ To bring attention to a question, Michelle, or ask for a change in its status (such as CW), please follow the "flag" link beneath the question. This will automatically notify all moderators. Embedding requests in questions, comments, or replies is hit-or-miss because it relies on the hope a moderator (or other high-rep user) will actually read it within a reasonable time! $\endgroup$
    – whuber ♦
    Feb 16, 2012 at 15:28
  • $\begingroup$ @whuber Ah, see I did think one of you would read it eventually. :) Thanks for the tip on using flags. $\endgroup$
    – Michelle
    Feb 16, 2012 at 19:23
  • 1
    $\begingroup$ Hi @ttnphns Why would they be better? In particular, why would studentized be better than standardized? (I've never really known the answer here) $\endgroup$
    – Peter Flom
    Oct 4, 2012 at 19:12
  • 4
    $\begingroup$ @Peter, Studentized residuals are less "distorted" by the OLS fitting algo and are closer to theoretical notion of "errors". They can be directly compared at different regions of the fit line, thence are better in decision if a point is an outlier. $\endgroup$
    – ttnphns
    Oct 5, 2012 at 6:58

2 Answers 2

Reset to default
9
$\begingroup$

This isn't so much an answer as a clarification on terminology. Your question asks about raw, standarized, and studentized residuals. However, this is not the terminology used by most statisticians, though I note your class notes state that it is.

Raw: same as you have it.

Standardized: this is actually the raw residuals divided by the true standard deviation of the residuals. As the true standard deviation is rarely known, a standardized residual is almost never used.

Internally Studentized: because the true standard deviation of the residuals is not typically known, the estimated standard deviation is used instead. This is an interanlly studentized residual, and it is what you called standardized.

Externally Studentized: the same as the internally studentized residual, except that the estimate of the standard deviation of the residuals is calcuated from a regression leaving out the observation in question.

Pearson: the raw residual divided by the standard deviation of the response variable (the y variable) rather than of the residuals. You don't have this one listed.

"leave one out": Doesn't have a formal name, but it is the same as the class notes.

standarized "leave one out": also doesn't have a formal name, but this is not what the class notes call studentized.

Sources:

  1. the same wiki link you have about studentized residuals ("a studentized residual is the quotient resulting from the division of a residual by an estimate of its standard deviation")

  2. documentation for residual calculation in SAS

Improve this answer
$\endgroup$
1
  • 2
    $\begingroup$ +1 Certainly some statisticians have used the terms in the OP's question (and not always perfectly consistently with others using the same words). I think the terms you use are becoming more common but I'm not sure on what basis we could guess at their relatively worldwide usage among statisticians -- papers, for example, don't necessarily help because the average statistician won't be actively publishing. You may be right -- but how would we know? [If you happen to edit again, you may want to replace "standarized" near the end with "standardized".] $\endgroup$
    – Glen_b
    Aug 4, 2014 at 22:42
2
$\begingroup$

Re: plots,

There is such a thing as overfitting, but overplotting cannot really do much harm, especially at diagnostics stage. A standardized normal probability plot cannot hurt next to your QQ-plot. I find it better to assess the middle of the distribution.

Re: residuals,

I run both standardized and studentized residuals at draft stage and usually end up coding the standardized ones. I don't know what other people actually run, because diagnostics are really coded down in the replication material that I find online.

Re: diagnostics,

For a linear model, I usually add variance inflation factors (with the vif command in Stata) and a few homoscedasticity tests (e.g. with the hettest command in Stata), as well as model decomposition with nested regression to check if the $R^2$ makes any sense.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.