Linked Questions
65 questions linked to/from How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?
28
votes
4
answers
12k
views
With categorical data, can there be clusters without the variables being related?
When trying to explain cluster analyses, it is common for people to misunderstand the process as being related to whether the variables are correlated. One way to get people past that confusion is a ...
16
votes
4
answers
31k
views
Do we need to set training set and testing set for clustering?
When we do classification and regression, we usually set testing and training sets to help us build and improve models.
However, when we do clustering do we also need to set testing and training sets?...
5
votes
5
answers
3k
views
Can any dataset be clustered or does there need to be some sort of pattern in the data?
If a clustering algorithm (e.g., Ward's clustering algorithm; based on the way various stimuli were rated on several continuous scales) succeeds (fulfils its math. objective function) in clustering a ...
6
votes
2
answers
7k
views
Using the gap statistic to compare algorithms
I want to compare the performances of two clustering algorithms that give me different numbers of clusters. I recently learned about the gap statistic. However, from what I have learned, this ...
3
votes
5
answers
2k
views
An algorithm similar to (or based on) K-means that do not require the 'k' number of clusters
These days I'm using a lot (and discovering) nice ways to use k-means' clustering. For example, clustering word embeddings (word2vec vectors) to find synonyms or clustering doc vectors (doc2vec) to ...
6
votes
1
answer
8k
views
Comparing a clustering algorithm partition to a "ground truth" one
I have a dataset $X$. Each sample of $X$ has a label $y$ that induce a partition $P$ of $k$ subsets of $X$.
If I feed a clustering algorithm with $X$, asking for $k$ clusters I would like to obtain a ...
5
votes
2
answers
7k
views
How to determine which method is the most valid, reasonable clustering results?
Method 1: Cluster by K-means with initial centroid {27, 67.5}
Method 2: Cluster by K-means with initial centroid {22.5, 60}
Method 3: Agglomerative Clustering
How can I know which method gives a ...
5
votes
2
answers
3k
views
Validation of clustering results
I have a data which contains several columns which I later reduced using a PCA algorithms to two different components. I then applied the k-means algorithms to the data.
Now, how can I verify that my ...
1
vote
3
answers
2k
views
What is the best way to present clustering result? [closed]
I know that for supervised classification one can use a confusion matrix to present the results. Is there an equivalent for this for clustering? And what's the best way to present clustering-...
6
votes
2
answers
2k
views
Validate Cluster Analysis by doing it on two subsamples
I am working on validating a cluster analysis. I have read somewhere the approach to cross-validate the cluster analysis. The link of the article is
http://jonathantemplin.com/files/clustering/...
3
votes
2
answers
7k
views
Difference between Ward hierarchical clustering and K-Means for classification
I have a dataset where of socio-demographic features of a population (expressed as percentages over the total population of the municipality: e.g. 12% of freelancers, 5% of unemployed etc.), each ...
2
votes
2
answers
3k
views
Clustering - Use ARI to compare different clustering
I have a data set of 54000 genes and I used different methods for clustering such as HAC, K-means, model based clustering and CLARA. The objective is to compare these methods. I used the Adjusted Rand ...
8
votes
2
answers
995
views
Choosing the number of clusters - clustering validation criterions vs domain theoretical considerations
I often face the issue of having to choose a k number of clusters.
The partition I end up choosing is more often based on visual and theoretical concerns rather than quality criteria.
I have two ...
4
votes
1
answer
3k
views
Dendrogram in Hybrid Hierarchical Clustering and Cut-off criterion (Calinski-Harabasz presently)
I have questions regarding the dendrogram and the cut-off related to hybrid hierarchical clustering performed on data, as depicted below and taken from this paper
Questions regarding Panel A (...
6
votes
1
answer
2k
views
Measures to compare clustering partitions
What are the most used measures (coefficients) to compare two partitions of objects into clusters? I am speaking of validating the results of clustering, not of classifying; the measures known as ...