Say I have four populations of samples, and I'd like to know if they are distinct or sampling the same process. Each sample is multivariate, and the distributions of the variables are non-normal. Furthermore the data set is quite noisy, so kernel-based PCA on all the samples gives no discernible structure.

I'd like to select those samples that best represent the underlying process(es), so I did the following: for each population I bootstrapped the mean for each variable, giving me a mean vector. To rate the samples, I computed the Pearson correlation coefficient between sample and corresponding mean vector.

My question is: Those samples that correlate the highest with their respective mean vectors, are they suitable for further analysis (e.g. clustering methods) or am I deluding myself?

  • $\begingroup$ How do you get bivariate correlation for a sample vs a mean vector? Are you doing this componentwise for each component in the vector? $\endgroup$ – Michael R. Chernick Jun 18 '12 at 15:36
  • $\begingroup$ @MichaelChernick, you've got me, actually. I simply did cor(x,y) in R, which returns a value (and also chooses samples that discriminate between groups, as it turns out). I suppose I should calculate the cosine of the angle between the two vectors? Or use Spearman's rank correlation? $\endgroup$ – user1134516 Jun 19 '12 at 9:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.