2
$\begingroup$

There seem to be too many points clustered around negative values for all the plots And while 3 & 4 seem to have random enough patterns, 1 & 2 seems to have negatively sloped trend.

If these were to violate linearity and homogeneity assumption, I should stop using the regression model, correct?

Residual plot variable 1

Residual plot variable 2

Residual plot variable 3

Residual Plot variable 4

$\endgroup$
0

1 Answer 1

5
$\begingroup$

Yes, the residual plots for variables 1 & 2 are problematic. I don't necessarily see any heterogeneity of variance (heteroscedasticity), or even non-linearity, but they certainly show non-independence. You can very clearly guess if a residual will be above or below 0 based on whether its neighbors are.

I do want to clear up a small misunderstanding. You state that you think there may be too many residuals below 0. It isn't that 50% of the residuals must be <0, and 50% above, rather the assumption is that the mean of the residuals is 0. If you have some skew in the distribution of the residuals, the mean won't equal the median, and you can validly have different numbers greater or less than 0.

I am perplexed, though. The OLS algorithm should ensure that what you see in your top two plots does not happen in regression. What code / program did you use to fit the data and generate these residuals? Did you force the intercept to be 0? That is the only thing I can think of that would produce the plots you show.

$\endgroup$
9
  • $\begingroup$ Thank you very much for your quick reply, and also the clarification on the mean of residuals. I actually simply use excel regression option in data analysis. And I did force the intercept to be 0. Is that something that I should not do? $\endgroup$
    – palm
    Commented May 23, 2014 at 4:23
  • $\begingroup$ Yeah, that's something you should not do; see here: When is it OK to remove the intercept in regression? $\endgroup$ Commented May 23, 2014 at 4:28
  • 1
    $\begingroup$ palm -- it sounds like you should post a new question. I couldn't really follow that first one, but if it's asking what I think, note that "independent variables" aren't actually independent. It (the dependent/independent thing for y and x) is a terminology I detest, actually, for this reason. On (2) neither are assumed to be normal. Many posts here discuss the issue. $\endgroup$
    – Glen_b
    Commented May 23, 2014 at 4:49
  • 1
    $\begingroup$ Only the residuals need to be normal, not X or Y, see my answer here: What if residuals are normal, but Y is not? You can have 2 variables that contain similar information, so long as it isn't identical, but it will make your SEs larger. It may or may not be a reasonable thing to do. $\endgroup$ Commented May 23, 2014 at 4:52
  • 1
    $\begingroup$ @palm, please register your account. $\endgroup$ Commented May 23, 2014 at 4:55

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.