Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.
up vote 2 down vote favorite
1

I am trying to use canopy clustering to provide initial clusters for KMeans in mahout.

Is there a way to determine / approximate the values of the distance thresholds T1 & T2 algorithmically? Right now I have T1 = 100 and T2 = 1 which doesn't seem to be doing anything good.

share|improve this question
This reference vaguely hints that T1 and T2 can be set with "cross-validation." Note that these thresholds depend intimately on the nature of the metric, on the dimension of the problem, and even on the distribution of the data. – whuber♦ Aug 5 '11 at 21:07
i have a fairly large data set, with >100K dimensions ( a couple of gigs ), is there a way of estimating the distribution / sampling technique that would work ? – bronzebeard Aug 6 '11 at 2:05

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.