I'm new to Statistics. How do we calculate the correlation coefficient from covariance, by Standardization or Normalization?

I understand, that for better interpretation, we calculate correlation coef. Since we are dividing covariance by the standard deviations of 2 RV, it makes sense to say that correlation is a "standardized value of covariance". But, in some text books, and blogs, I could see that people referring "correlation coef" as "normalized value of covariance". Are they using these terms interchangeably?

(To my knowledge, Normalization changes the values to be in the range of 0-1, and Standardization converts the values, such that it has 0 mean and 1 standard deviation.)

  • $\begingroup$ Normalization is a broader term than you say. For example, making mean or sum of squares of the data values is also called "normalization" (i.e. bringing "norm" to unit value). $\endgroup$ – ttnphns Oct 25 '19 at 16:52
  • $\begingroup$ Even if you are a new to statistics I would recommend you to read this which explains how and why covariance and correlation are kin. $\endgroup$ – ttnphns Oct 25 '19 at 16:56

"Normalization" and "standardization" are used in ambiguous ways in statistics and machine learning literature. They don't have any fixed meaning.

Pearson's correlation coefficient is defined as

$$ \operatorname{corr}(X,Y) = \frac{\operatorname{cov}(X,Y)}{\sigma(X) \; \sigma(Y)} $$

It is a "normalized covariance" in the sense that this operation transforms covariance to $[-1, 1]$ range, it has unified units that do not depend on the scaling (standard deviations) of $X$ and $Y$.

| cite | improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.