0
$\begingroup$

A pretty straightforward question:

Does it make sense to measure Kendall's tau correlation between let's say a vector $a$ with length $n=1000$ and a vector $b$ with $n=200$? Does $n$ have to be the same for both quantities involved?

How the coefficient behaves in the case that they are not?

Improve this question
$\endgroup$
3
  • 1
    $\begingroup$ It's not straightforward at all. My answer here is that the concept and calculation of correlation requires vectors not only of equal length but also in one-to-one correspondence, i.e. pairing of values is uniquely defined in some natural way, as when measurements are for the same people, places, times, or whatever it is. As it's not defined, there is no question of discussing how Kendall correlation behaves otherwise. $\endgroup$
    – Nick Cox
    Oct 28, 2015 at 15:00
  • $\begingroup$ The deeper question is how do you want to compare your vectors, as there are arbitrarily many ways to do that. You could, for example, construct some kind of outer product with each pairwise comparison forming one entry in a matrix. We need some idea of your purpose to advise well. $\endgroup$
    – Nick Cox
    Oct 28, 2015 at 15:01
  • $\begingroup$ Thanks. You are right, when reading the question is not so straightforward. Let me come with a better explanation in next coupled of days. Thanks for your time anyhow. $\endgroup$
    – Kwnwps
    Oct 28, 2015 at 15:39

1 Answer 1

Reset to default
1
$\begingroup$

To me this is a case involving computational complexity as it's applied in computer science. MDL or minimum description length is an information-theoretic metric for comparing these vectors that is rooted in the complexity of the contents of the vectors. MDL basically involves data compression and encryption. Here's the Wiki definition of MDL:

Any set of data can be represented by a string of symbols from a finite (say, binary) alphabet.

And the shortest path to representing that string is the MDL.

There's a good Wiki discussion here:

https://en.wikipedia.org/wiki/Minimum_description_length

as well as an excellent, wide-ranging book length discussion in Oded Goldreich's Computational Complexity:

http://www.amazon.com/Computational-Complexity-Perspective-Oded-Goldreich/dp/052188473X/ref=sr_1_1?ie=UTF8&qid=1446037485&sr=8-1&keywords=goldreich+computational+complexity

Improve this answer
$\endgroup$
2
  • 1
    $\begingroup$ Can you explain the relation between the question and your answer? $\endgroup$
    – Michael M
    Oct 28, 2015 at 14:59
  • $\begingroup$ @MichaelM Is your question as simple and precise as "do the n's have to be the same for both vectors*? If so, then you are correct that my answer completely misses that point! If not and you are asking how two vectors of differing length and, presumably, content are to be compared, then my answer offers one suggestion as to how to answer that question. $\endgroup$
    – Mike Hunter
    Oct 28, 2015 at 15:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.