Linked Questions

28 votes
4 answers
12k views

With categorical data, can there be clusters without the variables being related?

When trying to explain cluster analyses, it is common for people to misunderstand the process as being related to whether the variables are correlated. One way to get people past that confusion is a ...
gung - Reinstate Monica's user avatar
16 votes
4 answers
31k views

Do we need to set training set and testing set for clustering?

When we do classification and regression, we usually set testing and training sets to help us build and improve models. However, when we do clustering do we also need to set testing and training sets?...
rz.He's user avatar
  • 363
5 votes
5 answers
3k views

Can any dataset be clustered or does there need to be some sort of pattern in the data?

If a clustering algorithm (e.g., Ward's clustering algorithm; based on the way various stimuli were rated on several continuous scales) succeeds (fulfils its math. objective function) in clustering a ...
Dave's user avatar
  • 2,701
6 votes
2 answers
7k views

Using the gap statistic to compare algorithms

I want to compare the performances of two clustering algorithms that give me different numbers of clusters. I recently learned about the gap statistic. However, from what I have learned, this ...
bigTree's user avatar
  • 909
3 votes
5 answers
2k views

An algorithm similar to (or based on) K-means that do not require the 'k' number of clusters

These days I'm using a lot (and discovering) nice ways to use k-means' clustering. For example, clustering word embeddings (word2vec vectors) to find synonyms or clustering doc vectors (doc2vec) to ...
denisb411's user avatar
  • 163
6 votes
1 answer
8k views

Comparing a clustering algorithm partition to a "ground truth" one

I have a dataset $X$. Each sample of $X$ has a label $y$ that induce a partition $P$ of $k$ subsets of $X$. If I feed a clustering algorithm with $X$, asking for $k$ clusters I would like to obtain a ...
Ulderique Demoitre's user avatar
5 votes
2 answers
7k views

How to determine which method is the most valid, reasonable clustering results?

Method 1: Cluster by K-means with initial centroid {27, 67.5} Method 2: Cluster by K-means with initial centroid {22.5, 60} Method 3: Agglomerative Clustering How can I know which method gives a ...
user34582's user avatar
5 votes
2 answers
3k views

Validation of clustering results

I have a data which contains several columns which I later reduced using a PCA algorithms to two different components. I then applied the k-means algorithms to the data. Now, how can I verify that my ...
persistence911's user avatar
1 vote
3 answers
2k views

What is the best way to present clustering result? [closed]

I know that for supervised classification one can use a confusion matrix to present the results. Is there an equivalent for this for clustering? And what's the best way to present clustering-...
Learn_and_Share's user avatar
6 votes
2 answers
2k views

Validate Cluster Analysis by doing it on two subsamples

I am working on validating a cluster analysis. I have read somewhere the approach to cross-validate the cluster analysis. The link of the article is http://jonathantemplin.com/files/clustering/...
Riya's user avatar
  • 619
3 votes
2 answers
7k views

Difference between Ward hierarchical clustering and K-Means for classification

I have a dataset where of socio-demographic features of a population (expressed as percentages over the total population of the municipality: e.g. 12% of freelancers, 5% of unemployed etc.), each ...
sato's user avatar
  • 177
2 votes
2 answers
3k views

Clustering - Use ARI to compare different clustering

I have a data set of 54000 genes and I used different methods for clustering such as HAC, K-means, model based clustering and CLARA. The objective is to compare these methods. I used the Adjusted Rand ...
kaitokid's user avatar
  • 103
8 votes
2 answers
995 views

Choosing the number of clusters - clustering validation criterions vs domain theoretical considerations

I often face the issue of having to choose a k number of clusters. The partition I end up choosing is more often based on visual and theoretical concerns rather than quality criteria. I have two ...
giac's user avatar
  • 911
4 votes
1 answer
3k views

Dendrogram in Hybrid Hierarchical Clustering and Cut-off criterion (Calinski-Harabasz presently)

I have questions regarding the dendrogram and the cut-off related to hybrid hierarchical clustering performed on data, as depicted below and taken from this paper Questions regarding Panel A (...
Pugl's user avatar
  • 1,521
6 votes
1 answer
2k views

Measures to compare clustering partitions

What are the most used measures (coefficients) to compare two partitions of objects into clusters? I am speaking of validating the results of clustering, not of classifying; the measures known as ...
ttnphns's user avatar
  • 58.8k

15 30 50 per page