Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results for similarity of clusterings
Search options not deleted
196 votes

Clustering on the output of t-SNE

If we run t-SNE with a too small perplexity such as 20, we get more of these patterns that do not exist: This will cluster e.g. with DBSCAN, but it will yield four clusters. … In: Proceedings of the 10th International Conference on Similarity Search and Applications (SISAP), Munich, Germany. 2017 First, we have this input data: As you may guess, this is derived from a "color …
Erich Schubert's user avatar
98 votes

Choosing the right linkage method for hierarchical clustering

Two most dissimilar cluster members can happen to be very much dissimilar in comparison to two most similar. Single linkage method controls only nearest neighbours similarity. … The metaphor of this build of cluster is type. …
ttnphns's user avatar
  • 58.8k
97 votes
6 answers
171k views

Why does k-means clustering algorithm use only Euclidean distance metric?

Is there a specific purpose in terms of efficiency or functionality why the k-means algorithm does not use for example cosine (dis)similarity as a distance metric, but can only use the Euclidean norm? … "(Non)Euclidean distance" may concern distance between two data points or distance between a data point and a cluster centre. Both ways have been attempted to address in the answers so far.] …
curious's user avatar
  • 1,111
92 votes

How does a Support Vector Machine (SVM) work?

$\mathbf{w^T}$ is the transpose of $\mathbf{w}$, and $\|\mathbf{w}\| = \mathbf{w}^T\mathbf{w}$. Let: $\mathbf{x}$ be a feature vector (i.e., the input of the SVM). … cluster=469291847682573606&hl=en&as_sdt=0,22 ; http://www.chapelle.cc/olivier/pub/neco07.pdf …
Franck Dernoncourt's user avatar
89 votes
Accepted

How to tell if data is "clustered" enough for clustering algorithms to produce meaningful re...

the three clusters (krange) were dissolved across the samples, and the average clusterwise Jaccard similarity is > 0.95 for all clusters. … gamma, within sum of squares) for a range of cluster numbers (e.g., 2 to 10), repeat 100 or 500 times, and look at the boxplot of your statistic as a function of the number of cluster. …
chl's user avatar
  • 54.3k
77 votes
Accepted

How to select a clustering method? How to validate a cluster solution (to warrant the method...

I can imagine of a number dimensions or aspects of "rightness" of this or that clustering method: Cluster metaphor. … Each clustering algorithm or subalgorithm/method implies its corresponding structure/build/shape of a cluster. …
ttnphns's user avatar
  • 58.8k
74 votes
Accepted

Why do we do matching for causal inference vs regressing on confounders?

You estimate the treatment effect using a simple linear regression of the outcome on the treatment and the covariates, including the matching weights in the regression and using a cluster-robust standard … This all centers on covariate balance, the similarity between covariate distributions across the treatment groups. …
Noah's user avatar
  • 36.8k
69 votes
Accepted

Clustering a long list of strings (words) into similarity groups

It works on anything you can define the pairwise similarity on. Which you can get by multiplying the Levenshtein distance by -1. … cluster they are exemplar of): have: chances, edit, hand, have, high following: following problem: problem I: I, a, at, etc, in, list, of possibly: possibly cluster: cluster word: For, and, for, long …
Frames Catherine White's user avatar
69 votes
Accepted

Hierarchical clustering with mixed type data - what distance/similarity to use?

The facets of Gower similarity ($GS$): When all variables are quantitative (interval) then the coefficient is the range-normalized Manhattan distance converted into similarity. … A general coefficient of similarity and some of its properties // Biometrics, 1971, 27, 857-872 $^2$ Podani, J. …
ttnphns's user avatar
  • 58.8k
61 votes
5 answers
38k views

Apply word embeddings to entire document, to get a feature vector

I could use the word embedding to cluster the vocabulary of all words into a fixed set of clusters, say, 1000 clusters, where I use cosine similarity on the vectors as a measure of word similarity. … that are part of cluster $i$. …
D.W.'s user avatar
  • 6,738
58 votes
3 answers
115k views

Clustering a long list of strings (words) into similarity groups

I need to cluster this word list, such that similar words, for example words with similar edit (Levenshtein) distance appears in the same cluster. … For example "algorithm" and "alogrithm" should have high chances to appear in the same cluster. …
Ufuk Can Bicici's user avatar
54 votes
5 answers
67k views

Dynamic Time Warping Clustering

What would be the approach to use Dynamic Time Warping (DTW) to perform clustering of time series? … I have read about DTW as a way to find similarity between two time series, while they could be shifted in time. Can I use this method as a similarity measure for clustering algorithm like k-means? …
Kobe-Wan Kenobi's user avatar
53 votes

Comparing hierarchical clustering dendrograms obtained by different distances & methods

To compare the similarity of two hierarchical (tree-like) structures, measures based on cophenetic correlation idea are used. … If after the above precautions you continue to think that you want a measure of similarity between hierarchical classifications you might google on 'comparing of dendrograms' and 'comparing hierarchical …
ttnphns's user avatar
  • 58.8k
49 votes
Accepted

Clustering with a distance matrix

The algorithm is called Clara in R, and is described in chapter 3 of Finding Groups in Data: An Introduction to Cluster Analysis. by Kaufman, L and Rousseeuw, PJ (1990). … In R you can take a look at the package cluster. All described algorithms are implemented there. See ?pam, ?clara, ?hclust, ... Check also the different implementation of the algorithm in ?kmeans. …
Joris Meys's user avatar
  • 8,952
48 votes
8 answers
29k views

How to do community detection in a weighted social network/graph?

The graph in question has approximately 3 million edges and each edge expresses the degree of similarity between the two vertices it connects. … In particular, in this dataset edges are individuals and vertices are a measure of the similarity of their observed behavior. …
laramichaels's user avatar
  • 1,149

1
2 3 4 5
33
15 30 50 per page