What's the difference between correlation and simple linear regression?

Question

Is it cheating if I know the answer, but ask it anyways?

I figure it's good for people to know :)

In particular, I am referring to the Pearson product-moment correlation coefficient

Answer 1

What's the difference between the correlation between $X$ and $Y$ and a linear regression predicting $Y$ from $X$?

First, some similarities:

• the standardised regression coefficient is the same as Pearson's correlation coefficient
• The square of Pearson's correlation coefficient is the same as the $R^2$ in simple linear regression
• Neither simple linear regression nor correlation answer questions of causality directly. This point is important, because I've met people that think that simple regression can magically allow an inference that X causes Y.

Second, some differences:

• The regression equation (i.e., $a + bX$) can be used to make predictions on $Y$ based on values of $X$
• While correlation typically refers to the linear relationship, it can refer to other forms of dependence, such as polynomial or truly nonlinear relationships
• While correlation typically refers to Pearson's correlation coefficient, there are other types of correlation, such as Spearman's.

Answer 2

From correlation we can only get an index describing the linear relationship between two variables; in regression we can predict the relationship between more than two variables and can use it to identify which variables x can predict the outcome variable y.

Answer 3

Correlation is an index (just one number) of the strength of a relationship. Regression is an analysis (estimation of parameters of a model and statistical test of their significance) of the adequacy of a particular functional relationship. The size of the correlation is related to how accurate the predictions of the regression will be.

Answer 4

Correlation analysis only quantifies the relation between two variables ignoring which is dependent variable and which is independent. But before appliyng regression you have to calrify that impact of which variable you want to check on the other variable.

Answer 5

In the single predictor case of linear regression, the standardized slope has the same value as the correlation coefficient. The advantage of the linear regression is that the relationship can be described in such a way that you can predict (based on the relationship between the two variables) the score on the predicted variable given any particular value of the predictor variable. In particular one piece of information a linear regression gives you that a correlation does not is the intercept, the value on the predicted variable when the predictor is 0.

In short - they produce identical results computationally, but there are more elements which are capable of interpretation in the simple linear regression. If you are interested in simply characterizing the magnitude of the relationship between two variables, use correlation - if you are interested in predicting or explaining your results in terms of particular values you probably want regression.

Answer 6

Here is an answer I posted on the graphpad.com website:

Correlation and linear regression are not the same. Consider these differences:

• Correlation quantifies the degree to which two variables are related. Correlation does not fit a line through the data.
• With correlation you don't have to think about cause and effect. You simply quantify how well two variables relate to each other. With regression, you do have to think about cause and effect as the regression line is determined as the best way to predict Y from X.
• With correlation, it doesn't matter which of the two variables you call "X" and which you call "Y". You'll get the same correlation coefficient if you swap the two. With linear regression, the decision of which variable you call "X" and which you call "Y" matters a lot, as you'll get a different best-fit line if you swap the two. The line that best predicts Y from X is not the same as the line that predicts X from Y (unless you have perfect data with no scatter.)
• Correlation is almost always used when you measure both variables. It rarely is appropriate when one variable is something you experimentally manipulate. With linear regression, the X variable is usually something you experimentally manipulate (time, concentration...) and the Y variable is something you measure.