1
$\begingroup$

I am currently working on a modification of a clustering algorithm to suit my problem domain.

I want to know which methods are available for me to compare the centroids generated from the two methods?

That is, I want to know how well my (modified) clustering method agrees with the current method, the current method being the gold standard.

Would highly appreciate any help.

$\endgroup$
2
  • $\begingroup$ Do the two methods yield the same number of clusters w/ the same number of objects in each cluster? If these are different, can you specify how so? $\endgroup$ Commented Sep 1, 2014 at 2:27
  • $\begingroup$ Direct comparison (on the same dataset) between cluster solutions or between cluster solution and a ground truth partition is done by external clustering criteria. $\endgroup$
    – ttnphns
    Commented Sep 7, 2022 at 11:47

2 Answers 2

1
$\begingroup$

It depends on what clustering method you are using. There are many possible different definitions of what makes a clustering "good", and we could easily conceive of many datasets where there are more than 1 possible set of "good" clusters that are very different than each other.

Since you have your baseline clustering method that you are defining as "the gold standard" you should find what it's loss function is and use that. For example, k-means is attempting to minimize the function

$$ \sum_{i=1}^k \sum_{\forall x \in \text{ Cluster }_i } ||x-\mu_i||^2 $$

Where $\mu_i$ is the centroid for cluster i.

You can easily compute this for the results of k-means, and then any other algorithm that generates centroids for each cluster. Whichever has the lowest score is doing better at clustering by the defined metric.

$\endgroup$
0
$\begingroup$

There are plenty of external evaluation methods for clusterings.

https://en.wikipedia.org/wiki/Cluster_analysis#External_evaluation

Many of these measures are symmetric and thus well suited to compare two clusterings with respect to similarity. Maybe try ARI first, it is very popular.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.