1
$\begingroup$

I am very confused on the differences between linear and quadratic regression.

In linear regression, you have R, Pearson's correlation coefficient, which can tell you the strength and direction of a linear relationship, and R^2, the coefficient of determination, which can tell you how well the regression model fits the observed data, correct?

In quadratic regression, I believe it is slightly different. From my research, I have been unable to find out if R can be calculated for a quadratic model. If not, is there another kind of correlation coefficient that can describe the strength and direction of a quadratic relationship? I believe that in quadratic regression R^2 still acts as the coefficient of determination and can be used in the same fashion. Is this correct?

$\endgroup$
1

1 Answer 1

1
$\begingroup$

Remember what the sign of $R$ means.

$R>0$ means a generally increasing trend: as $x$ increases/decreases, $y$ tends to increase/decrease.

$R<0$ means a generally decreasing trend: as $x$ increases/decreases, $y$ tends to decrease/increase.

A quadratic polynomial includes increasing and decreasing sections. Consequently, it does not make sense to use $\pm$ the way that $R$ does.

However, $R^2$ makes sense. Fit the regression $\hat y=\hat\beta_0+\hat\beta_1x+\hat\beta_2x^2$ (drop the linear and/or intercept terms of you have compelling reasons for doing so, but probably only if you have compelling reasons for doing so), and calculate the $R^2$. Since this is linear in the parameters (even if you drop the intercept and/or linear term), the regression is linear, and $R^2$ has its usual interpretation of being the proportion of variance explained, so the strength of the relationship (bigger means a stronger relationship).

$\endgroup$
2
  • $\begingroup$ Thanks for the help! I was wondering if there was a different (weird) type of correlation coefficient that could do this for quadratic regression? May not even a CC just something that does the same sort of thing. $\endgroup$
    – BeeLong
    Commented Apr 6, 2022 at 20:14
  • $\begingroup$ @BeeLong I could see taking the square root and then considering the sign of the quadratic coefficient to say if the parabola opens up or down. This can be defended as a reasonable analogue of Pearson correlation, but it definitely does not measure the linear relationship between the two variables. $\endgroup$
    – Dave
    Commented Sep 1, 2023 at 16:38

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.