Questions tagged [dendrogram]
A dendrogram (or tree diagram) is a graph used to represent relationships in hierarchical clustering.
61
questions
2
votes
1
answer
31
views
How to compare two dendrograms
I want to find a method to compare two dendrograms. I have documents that were read by some people and they made a dendrogram that indicates which documents they think are more similar. Now I want to ...
- 21
1
vote
0
answers
212
views
Interpretation of the height of a dendrogram and intra/inter deviance corrispondence
I am practicing hierarchical clustering and I am having doubts about the interpretation of dendrogram height. Let's take the code in example with points (1,1), (2,2), (5,5), (9,9), (10,10), and (13,13)...
- 11
0
votes
0
answers
126
views
Finding correlations between categories using Correlations matrix and heatmap with dendrogram
I have a dataset with 5000 obs grouped by category:
1: science
0.5: philosophy
-0.5: medicine
-1: law
I would like to run some statistics to find correlations among variables within the groups, for ...
- 85
1
vote
1
answer
128
views
Clustering multivariate binary data
I want to use a clustering algorithm which can catch the following within a multivariate binary dataset. In the sample below, since class 1 and 2 appear twice within column A and B they will form a ...
- 13
0
votes
0
answers
22
views
Comparing cluserting structure of two datasets
I have two datasets, one with probands of a certain disease in it, the other has their siblings in it. Both of them contain the exact same variables (some phenotypes). Now, I would like to compare the ...
- 1
0
votes
0
answers
105
views
Variables plotted weirdly in a dendrogram (ClustOfVar for R)
I plotted a dendrogram using plot(hclustervar(X.quali=data)) from the R package ClustOfVar because I wanted to explore the structure behind the survey responses. All variables were coded as factors, ...
- 11
1
vote
1
answer
928
views
How to interpret a hierarchical clustering dendrogram?
I have a machine learning code that predicts whether a gene is likely to cause disease (the model gives the gene a score somewhere between 0 and 1, with 1 being causal for the disease).
The training ...
- 99
0
votes
2
answers
2k
views
Hierarchical clustering and Dendrogram interpretation
I'm quite new to cluster analysis and I was trying to perform a hierarchical clustering algorithm (in R) on my data to spot some groups in my dataset. Initially, I tried with the k-means, with the ...
1
vote
1
answer
54
views
Hotelling's $T^2$ test VS dendrogram
When i perform a Hotelling's $T^2$ test on a dataset, it stated that there is strong evidence that the mean vectors of the two groups differ. However, when I create a dendrogram, I got:
where number ...
- 199
0
votes
0
answers
449
views
Cutting dendrogram at certain point
I have a question about cutting dendrogram like that
It shows some hierarchy in the prison
I have to cut it to separate the group.
Is it possible to cut not all dendrograph at the same height like ...
- 1
0
votes
1
answer
76
views
Quantifying non-random distribution of label across dendrogram / correlation matrix?
Overview
Given a correlation matrix generated from $n$ observations, each of which is associated with one or categorical binary or multinomial labels, how can one quantify the (non-)random ...
- 201
3
votes
0
answers
2k
views
Hierarchical clustering dendrogram on a distance matrix
When computing hierarchical clustering over a data matrix, a dissimilarity matrix is first computed in order to build the tree (dendrogram). For example:
...
- 1,004
1
vote
1
answer
2k
views
Dendrogram: Hierachical Clustering on Text data
I would like to use hierarchical clustering for my text data using sklearn.cluster library in Python. However, when I plot the dendrogram to inspect where I should ...
0
votes
0
answers
444
views
Dendrogram y-axis labeling confusion
I have a large (106x106) correlation matrix in pandas with the following structure:
...
- 101
1
vote
1
answer
87
views
R: What is the distance function equivalent for this formula?
Hi I'm using an R package that calculates distance with this formula here,
as.dist(1 - cor(df, use = "pa"))
However I cannot seem to find an equivalent dist ...
- 331
2
votes
1
answer
2k
views
Hierarchical clustering in R - centroid linkage - problem with dendrogram heights
I have got a problem with understanding the hierarchical clustering algorythm, especially centroid linkage method. I have read many articles with description and they seems to be quite easy but I ...
- 23
1
vote
0
answers
938
views
Clustering correlated variables based on correlation matrix [duplicate]
I'm trying to group correlated variables together. I calculated the correlation matrix (Pearson correlation) and filtered out insignificantly correlated variables.
What I'm left with is this ...
- 121
3
votes
1
answer
204
views
Hierachical cluster analysis of ordinal variables?
I have a dataset containing 400 variables (chemical compounds, amount classes) with values 0,1,2, or 3 and 50 entries (species).
Can I use hierarchical cluster analysis to get a dendrogram that ...
- 31
2
votes
0
answers
171
views
Algorithm to sort the elements in a way that allows drawing non-crossing dendrograms out of Hierarchical Clustering [closed]
I have written from scratch (with Fortran) my own implementation of the Ward algorithm to perform HC. The output of the program consists of two elements: a vector with the distance after each step, ...
- 345
1
vote
0
answers
154
views
Test if order of objects in hierarchical clustering is uniformly distributed
I have performed hierarchical clustering and am looking for a way to test if a specific set of objects (genes, in this case) are clustered together.
From inspecting the output I cannot identify a ...
- 111
0
votes
0
answers
471
views
Visually comparing hierarchical clusterings
I'm working with a computational model. The model demonstrates the behaviour of a several sub metabolic systems (A, B, C, D, E, F, G, H, I and J) of a bacteria. I cluster these sub systems based on ...
- 133
2
votes
1
answer
224
views
Heatmap based on gene expression trend [closed]
Can anybody guide me on the R code for the following problem?
My data contains expression values of Genes A, B, C, D, E, F, G, H, and I in a time course study for two time steps, 48 and 72 hours, ...
- 21
0
votes
1
answer
1k
views
0
votes
2
answers
466
views
Dendrogram from table with repeated lines
I have some data from mass spectrometry of some plant samples (11 morphospecies and 4 treatments for each). Each species/treatment yields a graphic like the one below.
Each column in the graphic ...
- 339
1
vote
1
answer
430
views
Would anyone be able to help me interpret the dendrogram in the picture?
The dendrogram was obtained using SPSS, the Nearest Neighbor method alongside the Squared Euclidian Distance. It groups together glass fragments from 3 different origins but I have difficulties with ...
- 21
2
votes
0
answers
1k
views
Step-by-step: Ward's method for calculating linkage
I'm trying to use Ward's method to calculate linkage for hierarchical agglomerative clustering with the data points below:
$$a=(0,0)$$
$$b=(1,2)$$
$$c=(3,4)$$
$$d=(4,1)$...
- 61
4
votes
2
answers
3k
views
Applying Ward's method for calculating linkage
For an assignment, I have used iPython to create the dendrogram below, using Ward's method and Euclidean distance, from the following data:
$$a=(0,0)$$
$$b=(1,2)$$
$$c=(3,4)$$
$$d=(4,1)$$
$$e=(2,2)$$
...
- 61
0
votes
0
answers
551
views
Why does the heatmap of this gene expression data don't show a decent clustering here?
The heatmap has samples in columns and probesets/features in the rows. The genes are already selected based on a very low p-value threshold using 2 sample t-test on the two phenotypic subgroups of the ...
- 277
4
votes
1
answer
3k
views
Dendrogram in Hybrid Hierarchical Clustering and Cut-off criterion (Calinski-Harabasz presently)
I have questions regarding the dendrogram and the cut-off related to hybrid hierarchical clustering performed on data, as depicted below and taken from this paper
Questions regarding Panel A (...
- 1,441
1
vote
1
answer
753
views
Do heights between branches in R's heatmap dendrogram reflect true distances?
We are trying to interpret a heatmap that looks like this:
... and plotted with this plotting code:
...
- 111
5
votes
1
answer
2k
views
Purpose of dendrogram and hierarchical clustering
This is likely a very naive question. I've lately been reading about hierarchical clustering algorithms, and various discussions about how to interpret dendrograms or find optimal heights for cutting ...
- 51
2
votes
1
answer
3k
views
Centroid linkage clustering with hclust yields wrong dendrogram?
Let's look at this example:
...
- 1,351
3
votes
0
answers
484
views
Hierarchical Cluster Analysis validation
I have never used Hierarchical Cluster Analysis for inferential statistics before, but the dendrogram it produces provides a nice way to visualise my data. I applied the HCA to my variables with the <...
- 31
4
votes
1
answer
4k
views
Community detection and modularity
I am reading the book "Network science" of Barabasi and in particular the chapter on community detection.
If I understand correctly, modularity is a goodness factor of partition calculated by a ...
- 191
4
votes
0
answers
5k
views
A high cophenetic correlation coefficient but dendrogram seems bad
I have 2 results for the same dataset. One is hierarchical clustering using Ward's method and I got 0.75 cophenetic correlation coefficient. The second is average method and I got 0.91 cophenetic ...
- 309
3
votes
1
answer
4k
views
How to interpret the numeric values for "height" in a dendrogram using Ward's clustering method
I am a biology student investigating a new method of creating a dichotomous identification key. I have created a dendrogram using data I have collected from a survey on how people rate how similar ...
- 31
3
votes
3
answers
217
views
Cluster similarity matrix as energies
I have a symmetric score matrix and I would like to cluster the values in two dimensions rather than through a tree. Is there any method / library that would take the input matrix and treat the scores ...
- 201
4
votes
1
answer
429
views
How to specify K cluster in Hierarchical clustering with noisy data?
I'm new in Mining and Clustering and I wonder how to cut off the hierarchical clustering Dendrogram to obtain a specific number of clusters. The problem is here that the data is noisy and the ...
- 143
2
votes
0
answers
573
views
How many clusters would you divide this dendrogram into?
I'm struggling as to where to cut this dendrogram: any help would be appreciated.
Thanks
- 21
4
votes
1
answer
266
views
Get k most diverse objects from dendrogram (hierarchical clustering)
I have a dendrogram which groups similar object in a hierarchical order.
The problem I try to solve is based on a dendrogram how to get k most diverse objects.
E.g. We start with some random (?) ...
- 133
0
votes
0
answers
822
views
Structural Stability of Hierarchical Clustering
I am interested in some papers and reports about analysing the following problem:
Assume, we have a stream of objects and a defined similarity/distance measure to calculate similarity/distance between ...
- 133
2
votes
1
answer
5k
views
Cophenetic distance matrix to a dendrogram
In hierarchical clustering procedure, a distance matrix is used to construct a dendrogram with an appropriate method of clustering. In the process of constructing a dendrogram, a cophenetic matrix is ...
- 477
3
votes
1
answer
2k
views
Extract (ultrametric) distances from hclust or dendrogram
How can the matrix of (ultrametric) distances be extracted from the result of hclust (or a dendrogram in general) in R?
The ...
- 155
1
vote
0
answers
73
views
hypothesis testing in hierarchical trees
Suppose I have an hierarchical tree organising people according to their music preferences. Each person then has 3 extra properties A, B and C (e.g. parent's supportiveness on musical education).
I ...
- 11
0
votes
0
answers
4k
views
How to plot Optics Clustering result in Matlab (reachability plot)
I modified the following script for Optics clustering ( http://chemometria.us.edu.pl/download/OPTICS.M ) in order to work with DTW distance instead than Euclidean's.
I obtained the Order vector (...
3
votes
1
answer
843
views
Leaf ordering for hierarchical clustering dendrogram
Assuming merging process was completed and we have the history of n-1 merged clusters (merge two clusters p and ...
- 895
34
votes
3
answers
122k
views
How to interpret the dendrogram of a hierarchical cluster analysis
Consider the R example below:
plot( hclust(dist(USArrests), "ave") )
What exactly does the y-axis "Height" mean?
Looking at North Carolina and California (...
- 3,326
36
votes
1
answer
29k
views
Comparing hierarchical clustering dendrograms obtained by different distances & methods
[The initial title "Measurement of similarity for hierarchical clustering trees" was later changed by @ttnphns to better reflect the topic]
I am performing a number of hierarchical cluster analyses ...
- 2,162
3
votes
1
answer
514
views
Which similarity coefficient should I use with Ward linkage?
I just attempted implementations of Ward linkage and UPGMA linkage, as well as Pearson and Euclid similarity coefficients. To my surprise, both similarity coefficients gave the same clustering with ...
4
votes
0
answers
137
views
How to randomize the tips of a functional trait dendrogram? [closed]
I have generated a functional trait dendrogram using species x trait and plots x species matrices through dbFD in package FD. I want to randomize the tips of the ...
