15
$\begingroup$

I've been staring at the wikipedia page for distance correlation where it seems to be characterized by how it can be calculated. While I could do the calculations I struggle to get what distance correlation measures and why the the calculations look as they do.

Is there a (or many) more intuitive characterization of distance correlation that could help me understand what it measures?

I realize that asking for intuition is a bit vague, but if I knew what kind of intuition I was asking for I would probably not have asked in the first place. I would also be happy for intuition regarding the case of the distance correlation between two random variables (even though distance correlation is defined between two random vectors).

$\endgroup$

1 Answer 1

8
$\begingroup$

This my answer doesn't answer the question correctly. Please read the comments.

Let us compare usual covariance and distance covariance. The effective part of both are their numerators. (Denominators are simply averaging.) The numerator of covariance is the summed cross-product (= scalar product) of deviations from one point, the mean: $\Sigma (x_i-\mu^x)(y_i-\mu^y)$ (with superscripted $\mu$ as that centroid). To rewrite the expression in this style: $\Sigma d_{i\mu}^x d_{i\mu}^y$, with $d$ standing for the deviation of point $i$ from the centroid, i.e. its (signed) distance to the centroid. The covariance is defined by the sum of the products of the two distances over all points.

How things are with distance covariance? The numerator is, as you know, $\Sigma d_{ij}^x d_{ij}^y$. Isn't it very much like what we've written above? And what is the difference? Here, distance $d$ is between varying data points, not between a data point and the mean as above. The distance covariance is defined by the sum of the products of the two distances over all pairs of points.

Scalar product (between two entities - in our case, variables $x$ and $y$) based on co-distance from one fixed point is maximized when the data are arranged along one straight line. Scalar product based on co-distance from a var*i*able point is maximized when the data are arranged along a straight line locally, piecewisely; in other words, when the data overall represent chain of any shape, dependency of any shape.

And indeed, usual covariance is bigger when the relationship is closer to be perfect linear and variances are bigger. If you standardize the variances to a fixed unit, the covariance depends only on the strength of linear association, and it is then called Pearson correlation. And, as we know - and just have got some intuition why - distance covariance is bigger when the relationship is closer to be perfect curve and data spreads are bigger. If you standardize the spreads to a fixed unit, the covariance depends only on the strength of some curvilinear association, and it is then called Brownian (distance) correlation.

$\endgroup$
13
  • $\begingroup$ The second paragraph made it click for me. I don't' know why I didn't see that in the wikipedia page... Thanks! $\endgroup$ Commented Mar 6, 2014 at 8:13
  • $\begingroup$ Just wondering, where in en.wikipedia.org/wiki/Brownian_covariance#Distance_covariance is the numerator from your example (or how to get from your numerator to the wikipedia version)? Wikipedia just describe how to calculate the square of the distance covariance and I'm having a bit of trouble matching your description against the description there... $\endgroup$ Commented Mar 6, 2014 at 8:25
  • $\begingroup$ @Rasmus, my "numerator formula" agrees with the wikipedia formula of squared sample distance covariance. But I missed one (important) nuance that distances $d$ are transformed by double centering. I might have to edit my answer, therefore. I hope to find time to return in few days, if not tomorrow. $\endgroup$
    – ttnphns
    Commented Mar 6, 2014 at 17:44
  • $\begingroup$ Yes, the double centering has been puzzling me. Would be greatly appreachiated if you had the time to clarify that! :) $\endgroup$ Commented Mar 6, 2014 at 21:09
  • 1
    $\begingroup$ What still evades me is why a lower power, e.g. default $\alpha=1$, which shrinks and decenters the deviations obtained at the double centering, makes dCOV the statistic which has its unique property: it is 0 iff X and Y are statistically independent. Because I haven't got intuition or knowledge of it I'm afraid that my answer's 2nd paragraph is misinterpretation or simplification. I therefore inclined to delete my answer. Can you say anything? $\endgroup$
    – ttnphns
    Commented Mar 8, 2014 at 11:41

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.