Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [similarities]

Measures of closeness between distributions, clusterings, data sets or other objects.

1
vote
0answers
9 views

What can I use to compute a similarity (or diversity) index for a sample with “multidimensional” attributes?

Current problem: We have a batch of $n$ items for which we capture their details with $m$ attributes. It could look something like this: The goal is to compute an "index" that says how "similar" this ...
0
votes
0answers
21 views

Calculating and plotting set similarity [closed]

I have a goal where I want to plot sets of tags based on similarity representing each set of tags as a point. The sets can vary in size. An example of two data points could be ...
0
votes
0answers
4 views

How to comparing the similarity between two predictions with 2 fixed+1 alternative outcomes?

I want to compare the similarity of two diseases to Parkinson's disease (PD) with the same predictors. My first instinct is to run a multinomial regression with two fixed ends (healthy control and ...
0
votes
0answers
24 views

Similarity measure before and after dimensionality reduction or clustering

I have a dataset with 500 000 samples, each sample contains 30 features. The values of the features are in the range 0.0 to 1.0. ...
2
votes
1answer
31 views

Distance metric with characteristics of cosine and Manhattan

I'm working on a project where I want to find similarities between groups of events. So far I have expressed groups of events as vectors of event counts and computing similarities between them. I'm ...
0
votes
0answers
10 views

Mahalanobis: Covariance or correlation?

Is the Mahalanobis distance using correlations or covariances (among two vectors) to determine the similarity? I know that both are quite the same and differ only by a division of a standard deviation ...
1
vote
1answer
20 views

Clustering algorithm for similarity measure on quantitative values

I have a big set of subsets of 2 or more documents (maximum 10). The documents from each subset should describe the same product. One document contains pairs attribute - value: ...
0
votes
0answers
10 views

Correlation-like characteristic for ordinal feature with only three values

I have tabular data with two variables: one of them is regular continuous (float) variable and the second one is ordinal with three values only. I want to measure their dependency. (If it can help, I ...
2
votes
0answers
24 views

Random Forest Dissimilarity in plain ML English

I am currently studying the Random Forest algorithm for cases that involve unsupervised learning and I am struggling to understand what the Random Forest Dissimilarity concept is. So far what I ...
0
votes
1answer
17 views

Calculating similarity between two lists: high cosine similarity, but high RMSE

I want to see how similar two datasets are, as a way to justify that they can be used in similar contexts. In practice one dataset contains manually calculated data, and the other automatically ...
0
votes
1answer
33 views

Function of Matrix Profile Index and Joins

I would like to find similar motifs in a time-series using Matrix Profile, but by selecting the sub-sequence manually, instead of doing dimension reduction. Matrix Profile From what I understand, ...
0
votes
0answers
23 views

Different backgrounds, different similarities with ecospat (R language)

I beg all of you your excuses, because the stupid question. I am exploring niche conservatism in five species of Ericaceae. I created two backgrounds sets in order to explore niche similarity (using R ...
1
vote
1answer
33 views

How to use Matrix Profile for clustering

Matrix Profile (MP) has been used for clustering time-series segments. In the slideshow tutorial featured on the MP website, they use a figure to demonstrate projecting segment similarity onto an M-...
0
votes
0answers
12 views

Is there a method that's better than clustermaps for clustering samples which have a n of variables but only two possible outcomes?

For each variable there are two possible outcomes 1 or 0 (True or False): It shows the appearance of particular species on different localities. Mine goal is to cluster/classify similar localities ...
0
votes
1answer
40 views

Text Similarity - Cosine - Control. Suggestion to another / better method?

I would like to ask you, if anybody could check my code, because it was behaving weird - not working, giving me errors to suddenly working without changing anything - the code will be at the bottom. ...
0
votes
0answers
19 views

Fuzzy String Matching and Word Length

I'm attempting to calculate how likely it is that two words are the "same", but misspelled. I've narrowed it down to a few algorithms that will give me a similarity metric, but the problem is that ...
0
votes
1answer
25 views

Similarity index between two texts Ask Question

I'm trying to compare two vectors in a small NLP project using Python. Code doesn't make any difference since I'm using scikit-learn, but my doubts are about my calculations. I have a query vector ...
0
votes
1answer
23 views

Similarity between 2 profiles (observations). Is it possible to generate a % similarity?

I have multiple profiles for 10 different people. Each person has been measured for 5 different continuous variables of different magnitudes. So my dataframe is 10x5 where each row represents a person ...
0
votes
0answers
16 views

Somers' D deteriorating for more granular rankings

Background I have 30 observations and I want to compare how much experts and model agree with each other. For Model and Expert I have slots which are $\in [1,4]$ and ranking which are $\in [1,30]$. ...
0
votes
0answers
29 views

How to find Mahalanobis distance between an observation and a population with mixed data?

I have a dataset(let's call it as 'D') with multiple continuous, nominal and ordinal variables, as follows: continuous: Total sales as well as sales figures of some products by customers nominal: ...
1
vote
0answers
32 views

Similarities / suggestions of multi-attribute entities

Dataset: I have 200 000 entites, these have zero or more of 1000 attributes (commonly 1-20 of them) The attibute relation is weighted 1-3 Its stored in a relational database modeles as Entity, ...
2
votes
0answers
49 views

Similarity between Train and Test data sets

I have multiclass classification dataset and I am using Deep nets for the classification task. To explain the problem, let's assume that I have 5 classes to classify. No matter what I try, be it ...
-2
votes
1answer
48 views

Find similar images in a dataset without labels [closed]

I have a set of grayscale images, some of them are transformed of the other images. For example in 10 images, image 2 is the same as image 8 but rotated, and image 4 is the same as image 7 but ...
0
votes
1answer
50 views

Clustering visited vertex in a graph

I would like to know can anyone introduce me an algorithm to cluster multiple sequence of visited vertices in a graph. For example assume your graph has 6 nodes. following might be 3 different ...
0
votes
0answers
92 views

Type of Recommendation engine algorithm to use

I'm planning to build a recommendation engine for a market place. The market place has User1,User2,,,,,,,UserN (with new users joining all the time). Each user has city and state information. Market ...
-2
votes
1answer
19 views

R Find similiar combinations of entries in vectors

I have a problem where I have no idea how to solve it. I have many character vectors which entries are mostly containing 1-4 words. Here´s some sample data: ...
1
vote
0answers
18 views

Predicting categories based on a similarity matrix

I am looking for some help in organising some analyses. I will describe what I am trying to do with a fictional example and then talk about some of the things I've thought about already. Example I ...
0
votes
2answers
57 views

Similarity function for machine learning training examples

I have a bunch of training examples (which are time series segments) that are used to train an algorithm. For any new example that is now presented to the algorithm for classification, i want to the ...
0
votes
0answers
20 views

Quantifying similarity of two objects in a population on certain characteristics

I have a set of objects (these are businesses) and for these businesses I have data on a number of characteristics. To keep this simple, we will consider these to be number of staff number of ...
0
votes
0answers
19 views

Positional similarity

What is a good positional similarity measure? Bottom line - words, which are next to each other should be ranked higher (no semantic or fuzzy matching needed). I want to use this in addition to TF/IDF-...
0
votes
0answers
58 views

Similarity of two sets of points

PROBLEM I have one set of 10 points, $X = \{(x_1,y_1),\,\dots,\,(x_{10},y_{10})\}$ and two sets of 3 points each, $A = \{ (a_1,b_1),\, (a_2,b_2),\, (a_3,b_3) \}$ and $C = \{(c_1,d_1),\,(c_2,d_2),\,(...
0
votes
0answers
35 views

Evaluate the similarity of distributions that are a function of a continuous parameter

Consider a continuous bound independent variable $X$ (for context, the altitude angle measured on a telescope) for which one can measure zero or more values of a continuous dependent variable $Y(X_i)_{...
0
votes
0answers
25 views

Compare two set

I want to compare two sets of values with a ranking. I want to have more of a similarity coefficient. My goal is to take into account both aspects: the similarity on the ranking and the similarity on ...
1
vote
1answer
22 views

similarity distance when weight should change

I am trying to find a similarity measure for a very specific problem. I have a list of cities that have some characteritisques. For example bilingual school, firemen stations, etc. These cities are ...
0
votes
0answers
40 views

Is it possible to compare species compositions using some kind of analysis: anosim, adonis or PERMANOVA but using presence/absence of data?

Is it possible to compare species compositions between three groupss using some kind of analysis: anosim, adonis or PERMANOVA but using presence/absence data?
0
votes
0answers
65 views

On the right dissimilarity matrix for discrete cluster analysis

Currently I'm having some trouble on deciding the right dissimilarity matrix for my data. After reading some previously asked questions here, I'm even left more confused. So, here is the deal. My data ...
1
vote
0answers
25 views

Distance vs Dissimilarity measure

I am reading up on distance and dissimilarity measures for my class on natural language processing and could not understand this slide. Why does the dissimilarity measure not satisfy item 3 ? What ...
0
votes
0answers
29 views

Using some kind of similarity measure to predict target variable from historical data

Let me first describe the data I have: I have aggregated CAN bus data (1 second windows, from the original 50 ms values) from 6 forklifts, and I also have measurements for these 6 trucks which ...
1
vote
0answers
49 views

“Fuzzy” but simple and elegant similarity measure for time series

I am looking for a similarity measure between series which exploits the time dimension (rather than just its "mapping" aspect), and was unsatisfied with everything I found. First an example: assume I ...
0
votes
1answer
195 views

Best similarity measure for binary wine data

I'm creating a dataset of wine grape varieties and their associated flavors/aromas. Here's a schematic of the data: ...
2
votes
1answer
56 views

What is a “Nominal Type Histogram” and “Shuffling Invariant Property”?

I'm reading this paper about comparing histograms ["Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions" by Sung-Hyuk Cha] that writes in the introduction: ...
11
votes
2answers
228 views

Does Mercer's theorem work in reverse?

A colleague has a function $s$ and for our purposes it is a black-box. The function measures the similarity $s(a,b)$ of two objects. We know for sure that $s$ has these properties: The similarity ...
0
votes
0answers
22 views

Similarities between two networks

I am studying the similarities and differences between two research areas in terms of their descriptors (key words). I have two corpus corresponding to documents derived from both research areas. By ...
0
votes
0answers
65 views

Regression of pairwise trait similarity on similarity in personal attributes

I want to relate how simlar people are on their metabolite levels, to their similarity on personal attributes. Let's say I have measured metabolite levels for 500 metabolites in 1000 subjects. For ...
0
votes
0answers
34 views

similarity between position frequency matrices

I need to check the similarity between a set of position frequency matrices (finally to see if there is significant difference between 2 groups of 8 matrices). Simplified example of two matrices are ...
0
votes
0answers
24 views

What would be a good approach to find similar rows between datasets?

I have 4 different datasets with information about people. Examples of features in these datasets are region of residence, job, education, and age. These datasets represent annual catchments over 4 ...
-1
votes
2answers
213 views

Methods for evaluation of clustering

I have labeled data set (with only 2 classes) and I'm trying different clustering algorithms with different variations of similarity measures (which creates different distance matrixes that I give as ...
0
votes
1answer
26 views

Test Similarity of two models

I have two models that I've trained using different ML algorithms. I want to compare how well they match each other as a test of whether they are generalising the training set or simply memorising it. ...
0
votes
0answers
227 views

Similarity between documents in LDA “word” vectors space?

Using LDA we can convert a bag-of-words document into a vector of topics $\theta$ to incorporate statistical relations between words, then document similarity can be measured in the "topic" space by ...
5
votes
1answer
330 views

Are time series motifs and the Matrix profile algorithm a good fit for my problem?

I have huge multivariate time series to analyze (Terabytes of data) and I need fast, scalable algorithms for mainly two tasks: finding similar patterns among time series. For example, imagine I ...