# Questions tagged [hierarchical-clustering]

Hierarchical cluster analysis is a method of cluster analysis which builds, by steps, a hierarchy of clusters, a dendrogram. Most popular is agglomerative hierarchical clustering (HAC) which starts from individual objects and collects them into bigger and bigger clusters.

447 questions
Filter by
Sorted by
Tagged with
25 views

### Clustering similar words in different sets

Suppose I have $N$ sets as follow: $$S_1 = \{a_1,a_2,\cdots,a_n\}$$ $$S_2 = \{b_1,b_2,\cdots,b_n\}$$ $$S_3 = \{c_1,c_2,\cdots,c_n\}$$ $$\vdots$$ elements of each set (i.e., $a_n$, $b_n$, $c_n$ and etc)...
1 vote
3k views

### Different hierarchical clustering results

I'm running a hierarchical clustering on a sample of data using the steps below: ...
1 vote
34 views

### Comparing clustering methods based on internal Cluster Validity Indices

I have used the R package dtwclust to generate clusters for more than a thousand time-series objects.Since I did not have any prior information on the number or validity of clusters, I used a suite of ...
1 vote
242 views

### Unsupervised soft clustering methods

I have a D-dimensional dataset composed of exactly two clusters (this is known) for which I have no labels; the clusters can potentially be wildly imbalanced. I'm after a soft (or fuzzy) clustering ...
380 views

### How to specify K cluster in Hierarchical clustering with noisy data?

I'm new in Mining and Clustering and I wonder how to cut off the hierarchical clustering Dendrogram to obtain a specific number of clusters. The problem is here that the data is noisy and the ...
1 vote
165 views

### How to look into Agglomerative linkage matrix to find optimal number of clusters using python

I am generating the linkage matrix on 73k data-points. The objective is to find the cut-off point by visualising the distance ...
1 vote
27 views

### Do I correctly apply hierarchical clustering and K-means on the resource-selection-function values?

I'm trying to find the best way to classify bivariate point patterns in spatstat according to the relationship between two point species: Point pattern ...
14 views

### How can I code, process, and quantify the features of a hierarchical network in a scheme that admits siblingship but also auntship links?

I am new to network analysis and I am currently facing a challenge with coding, processing, and quantifying networks in a hierarchical scheme. In this scheme, nodes pertain to differing hierarchical ...
1 vote
10 views

### Should mixed-data (incl. weights) be pre-normalised/scaled/standardised before computation of a distance matrix for hierarchical clustering?

should i scale the mixed data type before i perform hierarchical clustering? A question very similar to mine was asked above however it wasn't quite answered... For background: I am using a large ...
1 vote
35 views

### Scale the data for cluster analysis

I have a time-series data. I would like to use (hierarchical) cluster analysis for them. I read that I need to scale my data. My question is, can I use empirical function (transfer the data into (0,1))...
169 views

### Distribution of conditional posterior for Gibbs sampling

The following is a description of how the authors (Yongning Wang & Ruey S. Tsay) of this (2019) paper Clustering Multiple Time Series with Structural Breaks want to perform Gibbs sampling to ...
19 views

### how to calculate the missclassification rate/ Accuracy rate for clustering?

I am working with cluster models. I tried to find an accuracy rate/misclassification rate manually. I found an example that confuses me. The example can be accessed from here. I think the author find ...
1 vote
8 views

### Determining the significance of left or right origin in a hierarchical lineage tree

I have a phylogenetic tree ( hierarchical lineage tree ). At the end of the branch, each sample is assigned, and each sample originated from either left or right. What I want to do is, at which level ...
15 views

### Measuring Similarity of Multidimensional Time Series

Suppose I have a non-linear time series comprised of 100 timesteps, within each I have 4 features for each of 50 observations. The features are not independent of eachother and the relationships ...
1 vote
1k views

### How to validate clusters after calculating Gower distances and Ward's clustering in R

I am trying to apply Ward's clustering on a mixed types dataset, and wanna explain what I did (maybe helpful to others), and I have some questions regarding this analysis, mainly how to validate my ...
12 views

### Approximately Unbiased P-value vs Bootstrap Probability: which one should i choose?

Some references first: How is approximately unbiased bootstrap better than a regular bootstrap with regards to hierarchical clustering? Suzuki et al. 2004 https://www.researchgate.net/publication/...
5 views

### Options for investigating hierarchical covariance structures

In many distinct contexts in biology, one covariance structure will emerge in a dataset of some kind if another covariance structure is present. As an example, we may consider proteins produced by ...
15 views

1 vote
5k views

### Difference between Ward hierarchical clustering and K-Means for classification

I have a dataset where of socio-demographic features of a population (expressed as percentages over the total population of the municipality: e.g. 12% of freelancers, 5% of unemployed etc.), each ...
1 vote
142 views

### How to compare consistency between clustering results and list of values with different levels in R?

I found similar subjects on the website but I may have missed the relation with my own question. I'v seen questions about comparison of clustering results, but here it's more about comparing two lists ...
1 vote
67 views

### Intuitive explanation of Ward's method

I got this explanation of the Ward's method of hierarchical clustering from Malhotra et. al (2017), and I don't really get what it means: Ward’s procedure is a variance method which attempts to ...
26 views

### Why does single linkage create loose clusters when it uses smallest distance between two points?

The definition of single linkage says: In single linkage method, the distance between two clusters is defined as the minimum distance between two data points in each cluster. However, different ...
796 views

### How to inform the space and time complexity of K-means, SOM and Hierachical clustering

In the paper I am writing, one of the reviewers asked for an "a simple computational complexity analysis or time computational demands of their method" My question is : Can I simply report the ...
1k views

### Splits in Decision Trees vs Dendrograms

gradient boosting is a supervised learning algorithm that splits/grows decision trees to improve predictions iteratively. hierarchical clustering is an unsupervised learning algorithm that splits/...
32 views

### Are height numbers meaningful when interpreting a cluster dendrogram? (Bray Curtis & ward.D2)

When interpreting a dendrogram produced with a Bray Curtis dissimilarity matrix, do the height numbers have more meany than just relative distance between clusters? Based on the dendrogram below and ...
2k views

### Fixing the maximum distance within a cluster

I am trying to cluster geographical locations in such a way that all the locations inside each cluster are at max within 25 miles of each other. For this, I am using Agglomerative clustering. I am ...
63 views

### How to Determine Cluster Count with Hierarchal Clustering

I have analyzed the following Data set in R using hierarchical analysis, and plotted the results. Ive been asked to find and highlight the number of clusters present, but how exactly do you determine ...
43 views

### Strange cluster assignment at edge of cluster

I'm experimenting with HDBSCAN and am encountering some results that I don't fully understand. Mainly about a datapoint that gets assigned to another cluster than I would expect it to be. Hopefully ...
14 views

### Compare hierarchical clustering results with different imporance scaling

For an assignment at university, I am using hierarchical clustering of a dataset of 5 different parameters. The parameters all have different magnitudes, so I standardized the data using a z-score ...
16 views

### Want to understand dendogram's basic expample from scipy website

I like to understand, how the given array leads to corresponding points in x and y coordinates? ...
1 vote
229 views

### Python Implemenatation of SPSS's Two-Step Clustering

I want to perform a clustering on data with ~40 binary features. I was recommended the two-step approach by Chiu et al.. They basically use a BIRCH variant to determine pre-clusters and then perform ...
1 vote
25 views

### Similarity between datasets A and B where B is a subset of A

I have two datasets A and B, and for each entry in both datasets I have a mixture of ordered and unordered categorical variables such as gender, age (integral value) and date. It is believed that ...
69 views

### Breaking Tie with Ward's Method Hierarchical Clustering

Viewing the set of single-feature observations below, I think its obvious that the appropriate Euclidean distance-based (e.g., Ward's method) number of clusters is 3. ...
12 views

### Testing individual effects on aggregate dependent variable

Please help! How do you test the effect of individual observations on an aggregate dependent variable? Can HLM or some other multilevel mixed effects model help me test this? I know these models can ...
1 vote
28 views

### Optimal number of clusters in gene expression data

I'm clustering genes on gene expression data. Here's a hierarchically clustered heatmap using ward linkage and Euclidean distance It clearly shows there are 5 or 6 clusters. Now when I evaluate their ...
575 views

### How does the coloring of dendrograms in SciPy work?

So I am clustering my data using linkage extensions. When I plot the diagrams of the dendrograms scipy chooses to color branches in different colors according to a "color threshold". As I ...
1 vote
22 views

### Does it make sense to use variables' product as a new variable in a clustering procedure?

I'm trying to separate different groups based on values from width and length using k-means and hierarchical clustering. My question relates to the possibility of using the area — measured as width * ...
79 views

### Are the distances on a hierarchical clustering dendrogram in the same units as the input distance matrix?

I use Aitchison distance as the input to a hierarchical clustering dendrogram. I started labeling and interpreting the dendrogram but wasn't sure about a few aspects: Are the vertical distances on ...
115 views

### Why clustering metrics are worse while adding some features?

I am facing something unexpected at first sight and would like to know if you could share some insights. Basically, I have performed a clustering on both qualitative and quantitative data using the ...
60 views

### Interpretation of the height of a dendrogram and intra/inter deviance corrispondence

I am practicing hierarchical clustering and I am having doubts about the interpretation of dendrogram height. Let's take the code in example with points (1,1), (2,2), (5,5), (9,9), (10,10), and (13,13)...