Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.
up vote 0 down vote favorite

I am trying to understand the relative behavior of the following rank correlation statistics:

  1. Spearman coefficient
  2. Kendall Tau / Concordance percentage
  3. Normalized Gini coefficient (area under curve of percentage captured versus percentage observations)
  4. Normalized Area under ROC curve (for binary classifiers)

I don't believe any of these are functionally related to the others. The accepted answer here references this paper and Spearman and Kendall are highly correlated (as one would expect).

Are there good intuitions behind/discussions of relative (across datasets) or absolute (for a given dataset) differences for (any pair of) these measures?

share|improve this question
ROC curve is not a rank order correlation statistic as far as I'm aware, I don't believe the Gini coefficient is either, as it is a measure of statistical dispersion. Perhaps I'm wrong or have misinterpreted. – analystic Oct 1 '12 at 4:46
Sorry, I did a poor job of defining what I mean -- rank by the prediction, not by the target. Then the Gini statistic (similarly ROC) as intended is similarly to how the term is used here. This is a somewhat standard usage (see for example, this random paper (pdf) from near the top of google's results. – cohoz Oct 2 '12 at 1:44
1  
I think you're misunderstanding two uses of the term "rank". Rho and Tau refer to calculating a monotonic relationship between two variables. The other two metrics are used for determining the effectiveness of a statistical model. In this sense, they may "rank" models according to their predictive power, and provide information about the models, however they are not measures of rank correlation. – analystic Oct 2 '12 at 11:43
Can you explain further? I am trying to see how well a predicted score ranks a target variable. The Gini is one way to do this. Why isn't Spearman's rho another? – cohoz Oct 3 '12 at 1:20
how does a "predicted scored rank a target variable"? I don't know what you mean by this. You have target variables and you have models which predict target variables, they don't rank them. However, the Gini index is not a model and doesn't predict a dependent variable, as I understand its use. – analystic Oct 5 '12 at 10:07
show 2 more comments

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.