20
$\begingroup$

I plan to do a simulation study where I compare the performance of several robust correlation techniques with different distributions (skewed, with outliers, etc.). With robust, I mean the ideal case of being robust against a) skewed distributions, b) outliers, and c) heavy tails.

Along with the Pearson correlation as a baseline, I was thinking to include following more robust measures:

  • Spearman's $\rho$
  • Percentage bend correlation (Wilcox, 1994, [1])
  • Minimum volume ellipsoid, minimum covariance determinant (cov.mve/ cov.mcd with the cor=TRUE option)
  • Probably, the winsorized correlation

Of course there are many more options (especially if you include robust regression techniques as well), but I want to restrict myself to the mostly used/ mostly promising approaches.

Now I have three questions (feel free to answer only single ones):

  1. Are there other robust correlational methods I could/ should include?
  2. Which robust correlation techniques are actually used in your field? (Speaking for psychological research: Except Spearman's $\rho$, I have never seen any robust correlation technique outside of a technical paper. Bootstrapping is getting more and more popular, but other robust statistics are more or less non-existent so far).
  3. Are there already systematical comparisons of multiple correlation techniques that you know of?

Also feel free to comment the list of methods given above.


[1] Wilcox, R. R. (1994). The percentage bend correlation coefficient. Psychometrika, 59, 601-616.

$\endgroup$

5 Answers 5

3
$\begingroup$

Coming from a psychology perspective, Pearson and Spearman's correlation do appear to be the most common. However, I think a lot of researchers in psychology engage in various data manipulation procedures on constituent variables prior to performing Pearson's correlation. I imagine any examination of robustness should consider the effects of:

  • transformations of one or both variables in order to make variables approximate a normal distribution
  • adjustment or deletion of outliers based on a statistical rule or knowledge of problems with an observation
$\endgroup$
2
$\begingroup$

I would recommend you this excellent article published in Science in 2011 that I previously posted here. There is proposal of one new robust measure together with exhaustive and excellent comparison with other ones. Moreover, all measures are tested on robustness. Note that this new measure is also capable to identify more than one functional relation in data and also to identify nonfunctional relationships.

$\endgroup$
8
  • $\begingroup$ Great! I will take a very close look on that. Looks very promising ... $\endgroup$
    – Felix S
    Commented Oct 11, 2012 at 12:27
  • 1
    $\begingroup$ Can you put the name of the article please? It seems to have disappeared! $\endgroup$
    – Creatron
    Commented Dec 24, 2013 at 3:19
  • 2
    $\begingroup$ Detecting Novel Associations in Large Data Sets $\endgroup$
    – sitems
    Commented Dec 24, 2013 at 8:16
  • 7
    $\begingroup$ That article has received a lot of critizism. It seems to be overhyped. Lots and lots and lots of media and PR work, but it seems to fail badly on trivial examples such as ▄▀ which it recognizes as "linear". IIRC their study also was not fair, as in they used ranks for their own method; but compared to pearson instead of spearman correlation. $\endgroup$ Commented May 26, 2014 at 9:51
  • 8
    $\begingroup$ Specifically, see rebuttals of this approach at: statweb.stanford.edu/~tibs/reshef/comment.pdf, ie.technion.ac.il/~gorfinm/files/science6.pdf, arxiv.org/abs/1301.7745v1 $\endgroup$ Commented Aug 20, 2014 at 20:46
1
$\begingroup$

Kendall's tau is very widely used in copula theory, probably because it is a very natural thing to consider for archimedean copulas. Plots of the cumulative Kendall tau were introduced by Genest and Rivest as a way to choose a model among families of bivariate copulas.

Link to Genest Rivest (1993) paper

$\endgroup$
1
$\begingroup$

Some robust measures of correlation are:

  1. Spearman’s Rank Correlation Coefficient

  2. Signum (Blomqvist) Correlation Coefficient

  3. Kendall’s Tau

  4. Bradley’s Absolute Correlation Coefficient

  5. Shevlyakov Correlation Coefficient

References:

• Blomqvist, N. (1950) "On a Measure of Dependence between Two Random Variables", Annals of Mathematical Statistics, 21(4): 593-600. • Bradley, C. (1985) “The Absolute Correlation”, The Mathematical Gazette, 69(447): 12-17. • Shevlyakov, G.L. (1997) “On Robust Estimation of a Correlation Coefficient”, Journal of Mathematical Sciences, 83(3): 434-438. • Spearman, C. (1904) "The Proof and Measurement of Association between Two Things", American Journal of Psychology, 15: 88-93.

$\endgroup$
1
$\begingroup$

Biweight midcorrelation implemented in R (very fast) via WGCNA and in Python (not so fast) via astropy. That's my go-to for network analysis.

For sparse compositional data, there's also SparCC and FastSpar

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.