Linked Questions

49 votes
4 answers
61k views

Evaluation measures of goodness or validity of clustering (without having truth labels) [duplicate]

I'm clustering a set of data but I don't have truth document that allow me to evaluate the result of clustering (I have unlabelled data), so I can not use an external evaluation measure. In this case, ...
shn's user avatar
  • 2,987
63 votes
3 answers
45k views

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?

One of the biggest issue with cluster analysis is that we may happen to have to derive different conclusion when base on different clustering methods used (including different linkage methods in ...
Learner's user avatar
  • 949
1 vote
2 answers
5k views

How to compare two clusterings generated by two clustering approaches

I am currently working on a modification of a clustering algorithm to suit my problem domain. I want to know which methods are available for me to compare the centroids generated from the two ...
Kosala's user avatar
  • 11
4 votes
1 answer
2k views

How to compare labels from clustering analysis and original ones?

I was asked to run a clustering analysis to assess the validity of labels for a manually labelled dataset. I can simply save the actual labels (4 classes: 0, 1, 2, 3) and run clustering analysis (let'...
AngelMarcos's user avatar
3 votes
2 answers
2k views

How to compute a 'pair confusion matrix'?

I don't really understand how the pair confusion matrix (used for example in comparing of clusterings) is calculated... ...
yyyLLL's user avatar
  • 33
5 votes
2 answers
2k views

Compare clustering results with different attributes and number of clusters

I used K-means to cluster a large data set that has millions of samples. I tried to create the clusters with different sets of attributes, which, as a result, generated different optimal number of ...
syd's user avatar
  • 159
1 vote
2 answers
1k views

Comparing two clustering methods with adjusted Rand index - How to make labels match

I have a set of data (countries), and I use a clustering method (Kmeans) to create two partitions on them based on different data (diet and covid stats). So I get two groups of partitions, and I want ...
Pythalex's user avatar
4 votes
1 answer
562 views

Measures to compare classification partitions

What are the most used measures (coefficients) to compare two partitions of objects into classes? I am speaking of validating the results of classification, not of clustering; the measures known as ...
ttnphns's user avatar
  • 58.8k
5 votes
2 answers
297 views

Is domain knowledge external validation in clustering?

I have cluster results with good values on etc Silhuette Width. The cluster sizes are: 4998, 1, 1 which isn't good knowing my customers doesn't have that particular partition (it's more balanced). I ...
ExchangedVisual111's user avatar
2 votes
0 answers
863 views

Alternatives to the Silhouette score in cluster analysis?

The silhouette score in my case gives quite misleading results, any alternatives? My data is a result of embedding words, which belong to one of the 20+ classes. I want to measure the "...
oliver.c's user avatar
  • 185
1 vote
1 answer
83 views

Finding a source for the definition of "clustering accuracy"

In papers about unsupervised clustering I see a lot of references to a metric "clustering accuracy" or "unsupervised clustering accuracy" (ACC) which is usually defined as ...
Cyo's user avatar
  • 11
1 vote
0 answers
43 views

Evaluate hierarchical clustering with partial ground truth

I am performing hierarchical clustering, and I need to decide which agglomeration method to use. While I don't have a ground truth, I know that some datapoints should be closer together: for example, ...
Alexlok's user avatar
  • 187
0 votes
0 answers
15 views

What is the standard performance metric for categorical data clustering?

I performed a categorical clustering with some selected UCI datasets. I one-hot encoded the features, then directly used Binomial Mixture Model and KModes using this one-hot encoded data. On the ...
NOT-A-CS-GUY's user avatar