Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

An online module I am studying states that one should never use Pearson correlation with proportion data. Why not?

Or, if it is sometimes OK or always OK, why?

share|improve this question
1  
What says this, and in what context? "Never" seems far too strong unless they're talking about some very limited situation. It may be that whoever wrote it is simply wrong, but without context how are we to guess? –  Glen_b Mar 31 at 4:04
1  
The online module is proprietary and I can't link it. However, I have found a video that states the same thing: australianbioinformatics.net/the-pipeline/2013/3/19/…. Both the module I have seen and this video indicate that there are no contexts in which correlating proportions is acceptable. –  user1205901 Mar 31 at 4:05
2  
"Never" is too strong. There are reasons to be cautious about interpreting correlation coefficients involving proportions, especially those based on small counts. But the same analysis supporting those reasons also shows that when proportions are based on large counts and the proportions are "sufficiently far" from $0$ or $1$, then the correlation coefficients are not problematic. Furthermore, one can always report a correlation coefficient for any set of paired data (where both components exhibit variation) as a summary (descriptive) statistic. –  whuber Apr 5 at 0:45

2 Answers 2

The video link of your comment sets the context to that of compositions, which may also be called mixtures. In these cases, the sum of the proportion of each component add up to 1. For example, Air is 78% nitrogen, 21% oxygen, and 1% other (total is 100%). Given that the amount of one component is completely determined by the others, any two components will have a perfect multi-linear relationship. For the air example, we have:

$x_{1} + x_{2} + x_{3} = 1$

so then:

$x_{1} = 1 - x_{2} - x_{3} $

$x_{2} = 1 - x_{1} - x_{3}$

$x_{3} = 1 - x_{1} - x_{2}$

So if you know any two components, the third is immediately known.

In general, the constraint on mixtures is

$\sum_{i=1}^{q} x_{i} = 1$

This constraint makes the levels of the factors $x_{i}$ non-indepenent.

You can compute a correlation between two components, but is not informative, as they are always correlated. You can read more about compositional analysis in Analysing data measured as proportional composition .

You can use correlation when the proportion data are from different domains. Say your response is fraction of dead pixels on an LCD screen. You could try to correlate this to, say, the fraction of helium used in a chemical processing step of the screen.

share|improve this answer
    
I see - I had mistakenly thought that the compositions were just an example. Is it thus fair to say that correlating proportions is generally unproblematic unless you've got a situation in which compositions 'force' a correlation to exist? –  user1205901 Mar 31 at 5:40
    
Given that the amount of one component is completely determined by the others, any two components will have a perfect co-linear relationship is not clear. Can you expand it? –  ttnphns Mar 31 at 5:48
    
I also do not understand this answer. In your 3-variable example, each is "determined" by TWO others, but the Pearson correlation only analyzes one variable in relation to ONE other. So, e.g, if looking at nitrogen vs. oxygen you could have a (nitrogen, oxygen) data set [ (0.78, 0.21), (0.20, 0.41), (0.44, 0.44) ], and you could do a valid correlation coefficient calculation on that data (and it's certainly not co-linear). The Pearson correlation coefficient does not know or care about "other" there... –  Jason C Mar 31 at 7:50
3  
As a kind of meta-comment, I would not expect to see inaccessible material cited as authority for any statistical point, not that you are proposing to do that. So, it's simple at one level: there is a literature on compositional data analysis, which is where to look; I am not an expert, so I can't say what's most authoritative on correlation, but my instinct is that the warning is exaggerated. Descriptive use of correlation can be helpful. It is just that inferences are complicated by the constraint on totals. –  Nick Cox Mar 31 at 8:12

This is for a case when several variables sum together to 1, in each observation. My answer will be intuition-level; this is intentional (and also, I'm not an expert of compositional data).

Let us have i.i.d. (hence zero-correlated) positive-valued variables which we then sum up and recompute as proportions of that sum. Then,

  • In case of two variables V1 V2, if V1 is said to vary freely then V2 has no room for freedom (since V1+V2=constant) and is fully fixed; the greater is V1 the lesser is V2, the lesser is V1 the greater is V2. Their correlation is but $-1$ and is always so.
  • In case of 3 variables V1 V2 V3, if V1 is said to vary freely then V2+V3 is fixed; which is to say that inside (V2+V3) each of the two variables are still partly free: they are on the average $1/2$ times fixed each, full fixed in total. So, if any one of the three variables is taken as free (like we took V1), any of the remaining two is expected $1/2$ fixed. So that the correlation between them is $-0.5$. This is the expected correlation; it may vary from sample to sample.
  • In case of 4 variables V1 V2 V3 V4 by the same reasoning we have that, if we take any one of the four as free then any one of the remaining is expected to be $1/3$ fixed; so, the expected correlation between any pair of the four - one as free the other as $1/3$ fixed - is $-0.333$.
  • As the number of (initially i.i.d.) variables grows, the expected pairwise correlation grows from negative towards $0$, and its variation from sample to sample becomes larger.
share|improve this answer
    
OK, but I guess the interest is in pairs V1, V2, each V summing to 1 ( 100%), but no constraint on individual V except each being a fraction. –  Nick Cox Mar 31 at 10:57
    
each V summing to 1 ( 100%) Excuse me? I didn't understand you. I put no constraint on individual V, only being a fraction. However, initial constraint was that my example assumes zero correlations prior turning Vs into fractions. –  ttnphns Mar 31 at 11:12
    
Did you mean that each V has values summing to 1 ("vertically")? No, I meant "horisontally", across variables. But unfortunately the OP didn't elucidate the point in their question. So I took it as I took it. –  ttnphns Mar 31 at 11:18
    
Yes; that is I think what is usually meant here, but the question is not especially clear. –  Nick Cox Mar 31 at 11:54
1  
@ttnphns I saw a statement that one should never do a Pearson correlation two variables measured as proportions. I've tried to make this clearer by editing the OP to highlight the word 'never'. The video makes the same statement in its title ("Don't correlate proportions!"), though they only discuss this in the context of compositional data. I deliberately left the context undefined because my source stated that Pearson correlations should not be used on proportion data in any context. However, it seems the answer to my question is: "Correlating proportions is fine, except in some contexts." –  user1205901 Mar 31 at 23:48

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.