Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

Say I have four populations of samples, and I'd like to know if they are distinct or sampling the same process. Each sample is multivariate, and the distributions of the variables are non-normal. Furthermore the data set is quite noisy, so kernel-based PCA on all the samples gives no discernible structure.

I'd like to select those samples that best represent the underlying process(es), so I did the following: for each population I bootstrapped the mean for each variable, giving me a mean vector. To rate the samples, I computed the Pearson correlation coefficient between sample and corresponding mean vector.

My question is: Those samples that correlate the highest with their respective mean vectors, are they suitable for further analysis (e.g. clustering methods) or am I deluding myself?

share|improve this question
How do you get bivariate correlation for a sample vs a mean vector? Are you doing this componentwise for each component in the vector? – Michael Chernick Jun 18 '12 at 15:36
@MichaelChernick, you've got me, actually. I simply did cor(x,y) in R, which returns a value (and also chooses samples that discriminate between groups, as it turns out). I suppose I should calculate the cosine of the angle between the two vectors? Or use Spearman's rank correlation? – user1134516 Jun 19 '12 at 9:44

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.