11
votes
4answers
24k views

Similarities and differences between correlation and regression [duplicate]

If I want to investigate how two continuous variables are linked, what is the difference between calculating the correlation coefficient (Pearson's $r$) versus calculating the (simple linear) ...
1
vote
0answers
469 views

Conceptual difference between correlation and regression [duplicate]

In my corner of the world, I encounter this situation. A student will work on his/her dissertation/thesis and have a set of variables. To address the hypothesis, the student conducts a correlation ...
1
vote
1answer
555 views

What is the difference between Correlation and Regression for a layman ? [duplicate]

I am learning Statistics as a prerequisite for Data Science course. I would like to know the difference between Correlation and Regression with an example. Could someone help me please ?
0
votes
0answers
9 views

Correlating continuous variables to y [duplicate]

In a simple linear regression without intercept, if beta is 0.5 and X is continuous from 0 to 100, why is there a positive correlation between x & y? (x is confidence; y is wages)
86
votes
7answers
155k views

What is the difference between linear regression on y with x and x with y?

The Pearson correlation coefficient of x and y is the same, whether you compute pearson(x, y) or pearson(y, x). This suggests that doing a linear regression of y given x or x given y should be the ...
58
votes
8answers
8k views

The Book of Why by Judea Pearl: Why is he bashing statistics?

I am reading The Book of Why by Judea Pearl, and it is getting under my skin1. Specifically, it appears to me that he is unconditionally bashing "classical" statistics by putting up a straw man ...
24
votes
8answers
45k views

When forcing intercept of 0 in linear regression is acceptable/advisable [duplicate]

I have a regression model to estimate the completion time of a process, based on various factors. I have 200 trials of these processes, where the 9 factors being measured vary widely. When I perform a ...
5
votes
1answer
442 views

Why don't the results of testing $H_0 : \beta = 0$ and $H_0 : {\rm cor}(X,Y)=0$ agree?

I have 4 IVs in my model that directly effect the DV. The results of the correlation & regression analyses showed that: IV1&DV: Pearson Correlation Coefficient: insignificant Regression ...
1
vote
1answer
1k views

When to look at the P value of the slope and when at the P value of a cor.test()

This question was edited to clairify my question, for the old question see the edit log I found this about regression and correlation: Regression is different from correlation because it try to ...
4
votes
0answers
2k views

Assumptions of correlation test vs regression slope test (significance testing)

If my understanding is correct, then the test on a regression slope in a simple bivariate regression - i.e. the test of $\mathcal{H}_0$: $b = 0$ in $Y' = a + bX$ and the test of a correlation, i.e. $...
1
vote
0answers
507 views

Correlation vs Regression: Which method to use?

I understand that correlation (I'm referring to Pearson product-moment correlation coefficient) and regression share some similarities from this post: What's the difference between correlation and ...
2
votes
1answer
156 views

If regression is supervised learning is correlation unsupervised learning?

Regression is often given as a simple example for supervised learning because you have a dependent variable and try to build a model with the independent variables. Could you say that correlation is ...
0
votes
0answers
161 views

What to watch out for when regressing Y on X when not only Y influences X but also X influences Y?

My data (about 20-30 data points) seems to be following a quadratic pattern, and it's quite plausible that they influence each other: For $X < 16$, the influence (direction of "Granger-causality") ...
2
votes
1answer
56 views

correlation between two variables within a third group

I'm testing correlation between two variables v1 and v2, but they are clustered by a third variable ...