0
$\begingroup$

I have run a multiple linear regression with 4 IVs. Three of the IVs are constructs and the fourth is gender. All IVs have statistically significant correlations with the DV. All three construct IVs have partial correlation coefficients that are negative. The gender "being female" has a positive correlation coefficient of .2 that is stat significant.

The r on the other hand is positive... 0.5.

How do I interpret this? How can the overall model predict a positive effect on the DV while all of the construct IVs have a statistically significant negative effect on the DV? Is the strength of "being female" enough to overcome all the other IV effects? Yet .2 is not that strong a correlation.

Or am I missing something simple?

$\endgroup$
2
  • 3
    $\begingroup$ I am not aware of a quantity "r" in regression analysis. Are you referring to $R^2$? If so, don't confuse the coefficient of determination (which is always positive) with a correlation (which is between -1 and 1): en.wikipedia.org/wiki/Coefficient_of_determination $\endgroup$ May 13, 2014 at 12:53
  • $\begingroup$ What 'r' are you talking about? $\endgroup$
    – Glen_b
    May 14, 2014 at 6:20

1 Answer 1

4
$\begingroup$

There is such a thing as a multiple correlation coefficient, although almost no one seems to know it exists. In addition, it does not come standard with output from any statistical software, as far as I know. So I suspect that you are looking at $R^2$, as @StephanKolassa suggests. You can think of this as the proportion of the variance in your DV that your model helps to explain. Unless something has gone horribly awry (see, e.g., When is $R^2$ negative?), this value will always be positive (you can't explain less than zero of what's going on).

For what it's worth, the multiple correlation coefficient is the correlation between your model's predicted values, $\hat y$, and the actual values of your DV, $y$. Again, unless your model is badly misspecified, the procedure used to fit your model coefficients works in such a way that this will always be positive, even if the individual coefficients / correlations are negative. In other words, when a data point has a higher (lower) value, your model predicts a higher (lower) value, even if this occurs when $x$ is at a lower (higher) value.

Here is a simple demonstration using only one variable to make it easier to see. I don't know if you are familiar with the statistical software R, but hopefully the code is sufficiently self-explanatory.

set.seed(3293)                   # this makes the example exactly reproducible
x     = rnorm(20, mean=5, sd=1)  # these generate random data for x & y
y     = 9 - 1*x + rnorm(20, mean=0, sd=1)
model = lm(y~x)        # here I fit a simple linear regression
cor(x, y)              # this is the correlation between x & y
# [1] -0.6276509
cor(fitted(model), y)  # this is the correlation w/ the model's predicted values
# [1] 0.6276509
summary(model)         # here is the model output, the coefficient is -, but R2 is +
# ...
# Coefficients:
#             Estimate Std. Error t value Pr(>|t|)    
# (Intercept)   9.0107     1.4055   6.411 4.91e-06 ***
# x            -1.0144     0.2966  -3.421  0.00305 ** 
#   ---
#   Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
# 
# Residual standard error: 1.298 on 18 degrees of freedom
# Multiple R-squared:  0.3939,  Adjusted R-squared:  0.3603 
# F-statistic:  11.7 on 1 and 18 DF,  p-value: 0.003049

Below is what this looks like. Notice that you have lower y values associated with higher x values, but that higher y values are associated with higher fitted y values.

enter image description here

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.