# Questions tagged [similarities]

Measures of closeness between distributions, clusterings, data sets or other objects.

359 questions
Filter by
Sorted by
Tagged with
9 views

### Similarity measure for two lists of scores

I have a finite set of items, a score for each item, and a series of orderings: ...
8 views

### I don't understand the task of finding the correlation in WordSimilarity-353

My issue is the following, I have created word embeddings using WordNet, and to test my embeddings to see how they stack up against the word similarities in WordSimilarity-353 I'm running a script ...
46 views

### Rao-Stirling diversity index

I need help to calculate the Rao-Stirling diversity index. I tried it several times but cannot achieve equal results to R packages yet (e.g. diverse). I used the Rao-Stirling diversity index as ...
13 views

### Dynamic Time Warping and non-stationarity of time series

Dynamic Time Warping (DTW) computes the optimal alignment between points of two time series. If we consider two non-stationary time series (e.g. the first proportional to the second), is the DTW ...
4 views

### RBF-Kernel: Handling missing values

I want to compute the RBF-Kernel for a dataset which contains missing values: ...
27 views

### Distance measure for two probability distribution of unequal sample size

Context: I have 100 stores and these stores are divided into 10 business markets. I want to select 3 markets where each market is a good representation of the 100 stores i.e. the population. There ...
116 views

### Finding similarity between two datasets [closed]

I have two datasets. One is actual percentage of white population in counties in an american state and the other is the simulated percentage of white population in counties in an american state. ...
17 views

### Probability that output is result of the same process?

I've developed a simple Monte-Carlo simulation. Output of this simulation is a histogram. This histogram is possibly a log-normal distribution, but I don't want to assume that. But I do know that the ...
16 views

### Training classifier on randomly generated negative samples

I have $M$ (~dozen million) feature vectors. There are $F$ (~several dozen thousand) binary features, but in each vector, only $H$ (~several hundred) of them would be 1, the rest are 0. Now, for a ...
15 views

### Understanding formula for comparing players based on certain metrics

I'm looking at this tool: https://www.capfriendly.com/comparables/ and trying to understand the formula behind its rankings. I don't really need the exact formula, I really just need a way to compare ...
41 views

### Cosine similarity vs quadratic objective function

The aim is to calculate the similarity between two foods given the nutritional content of each. After some reading, it seems the most popular measure for this sort of problem is the cosine similarity ...
80 views

### FindSimilar items in a complex dataset

Im a MachineLearning newbie, but I want to learn more about this interesting topic using a practical example, on which I would appreciate any theoretical and practical help: I have a database of "...
35 views

### Weigh Kullback Leibler Divergence with P entropy?

I'm wondering if it makes sense to weight Kullback-Leibler Divergences to highlight divergences on highly distinguishing features. I am however not very well versed in Information Theory, and would ...
36 views

### Name of a similarity test for Ordinal data to see how similar a set of participant answers are to expert answers

I asked 12 participants in a small experiment to order 5 distorted webpages from the least to most trustworthy (1 - 5). I want to know the best way to test how similar participants answers are to a ...
29 views

### How do I statistically compare the readings from two different sensors? [duplicate]

I have temperature and humidity readings from two different sensors (located in the same geographical area). The data is logged every hour and I have data for more than a year, logged this way 2/1/...
63 views

### How to find similar users in a social network

I have a set of users from a social network. These users are represented by large sparse vectors. Let's say that a small subset of those users bought a ticket for a particular movie. How could I find ...
36 views

### What is the method should I use to calculate similarity in a data set with outliers that must be included?

Information: So I have a data set with 18 vectors with 167 components, each of with has a value with a range of $[-2, 2]$. I am trying to calculate the similarity between one arbitrary vector in ...
209 views

### Dynamic Time Warping vs Cross Correlation

Consider the following data frames: > df1 value 1 6 2 2 3 3 4 1 > df2 value 1 3 2 8 3 4 4 5 I want to find the ...
67 views

### multiple measurements for classification; which one to choose?

There are five different classes (labels) where the new points have to be classified at. For each new point, five different measurements are conducted, resulting into similar although different values ...
16 views

### Compute simliarity between two sets of numbers with each set summing up to 100%?

I have product shares for different users. Need to find similarity between users based on these product shares. For Example, User 1 Prod A: 44% Prod B: 33% Prod C: 23% User 2 Prod A: 76% Prod B: 24%...
53 views

### How to compare two bayesian linear models?

Let say, we have two bayesian linear models learned from some data (not necessarily same but from the same data distribution), how can we compare or what is the notion of similarity between the two ...
213 views

### Interpretation of clustering on similarity matrix

Many papers suggest doing clustering not on the (n x p)raw data but on the n x n or p x p matrices computed according to determined similarity measures (eg, correlation, cosine, point mutual ...
56 views

### Can Bhattacharyya coefficient (or distance) be used as an additive measure to compute a metric for performance?

As far as I understand, Bhattacharyya's measure(s) can be used to see similarity between two empirical distributions. Other ways to do so are nicely explained here: Similarity measure between multiple ...
142 views

### Is Hierarchical clustering a special case of knn(specific n=1)?

I'am working on time series in the scope of similarity detection at the moment. What seems to be a well researched approach is dynamic time warping in combination with k-1NN as classification ...
10 views

### Vector representation of subsets of data in python

I have 141575 data points that can be divided into 153 blocks. There are around 70 features in my dataset. I want to measure similarity among the blocks and rule out outliers during training my model. ...
121 views

### How different will that be between the R-squared of linear regression y~x and square of cor(x,y)

Generally, both of them can represent the linear relationship between x and y scale to [0,1]. Are they 99% very similar?
31 views

### Set Similarity Measure that accounts for size

Suppose I have two sets, A and B where 10|A| = |B| and A is a subset of B. For the case where |A| = 1 the Jaccard similarity of the sets will be 0.1. For the case where |A| = 100 the Jaccard ...
38 views

### Practical handling of Dynamic Time Warping for time-series with unequal sampling frequency (irregular time series)

Hi all and thank you for taking time to read this. When I read the general literature about dynamical time warping (and the vignette for the $\texttt{R}$ package $\texttt{dtw}$), the time series seem ...
18 views

### How to Measure/Quantify Similarity between > 2 Sets of Dummies Indicators

I have multiple sets, each with a binary indicator for whether an element is part of the set. ...
53 views

### Clustering high dimensional data

I was going through this wiki page on clustering in high dimensions and I don't understand the following statement there. Can someone explain to me what this means? The concept of distance becomes ...
90 views

7 views

### How to comparing the similarity between two predictions with 2 fixed+1 alternative outcomes?

I want to compare the similarity of two diseases to Parkinson's disease (PD) with the same predictors. My first instinct is to run a multinomial regression with two fixed ends (healthy control and ...
37 views

### Similarity measure before and after dimensionality reduction or clustering

I have a dataset with 500 000 samples, each sample contains 30 features. The values of the features are in the range 0.0 to 1.0. ...