2
$\begingroup$

I am reviewing a friend's paper, and they are throwing out variables that are below a certain correlation coefficient value before doing a multiple linear regression model.
Is this a wise thing to do? They are investigating transformations of variables as well, and I feel like a variable that is not linearly correlated could become very informative after a transformation.

$\endgroup$
1
  • 2
    $\begingroup$ for example x and x^2 $\endgroup$
    – rep_ho
    Aug 8, 2022 at 13:56

1 Answer 1

10
$\begingroup$

Yes, you can have zero correlation when you have a nonlinear dependency. For example, $y=x^2$ will have a correlation coefficient of zero, and the linear regression will fit a horizontal line. but regression to $y=ax^2+bx+c$ will show the dependency.

enter image description here

$\endgroup$
2
  • 1
    $\begingroup$ Thanks! This is a really great visualization for this question. $\endgroup$
    – Ryan Folks
    Aug 8, 2022 at 14:28
  • $\begingroup$ You could also consider y=mod(x,2) - nonlinear functions can be very nonlinear indeed $\endgroup$ Aug 9, 2022 at 14:55

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.