Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

Is it possible to obtain a positive correlation between a regressor and a response (+0,43) and, after that, obtain a negative coeficient in the fitted regression model for this regressor?

I'm not talking about changes in the sign of the regressor among some models. The coeficient sign always remain.

Could the remaining variables of the fitted model influence in the changing of the sign?

share|improve this question
1  
You will find a similar question and answers here : stats.stackexchange.com/questions/33888/… – JDav Aug 11 '12 at 22:48

2 Answers

Both @Henry, and @JDav are pointing you in the right direction (+1 to each). However, I'm very visual and it helps me if I can see how this works. In that respect, here's a quick plot in which the first variable is confounded with group membership. If the groups are ignored, the correlation coefficient is positive (as can be seen in the figure), but in a multiple regression, $\beta_{x1}=-1$, albeit with different intercepts for the three groups. enter image description here
As further food for thought, when all variables are categorical (instead of continuous as in this case) the phenomenon of reversing the apparent relationship upon inclusion of other variables is known as Simpson's paradox. Since it's ultimately quite similar, it may help to read about that as well. It is discussed on CV here.

share|improve this answer

If the positively-correlated regressor is the only regressor in a linear model then its coefficient should be positive.

If there are several regressors and they are not independent then you can see the effect you are asking about. Read about confounding for some explanation

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.