The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
0answers
13 views

Similarity scoring to compare multi-dimensional datasets

I am trying to come up with a mechanism of scoring a set of multidimensional datasets based on a similarity with an ideal dataset. Each dataset will all have the same dimensions along with the ideal. ...
0
votes
0answers
16 views

How to measure consistency or simiarity between two data sets?

I am working on a study that elicits priorities (weights) from experts on a set of alternatives using different methods. The snapshot below shows the resulting weights, which sum up to 1 for each ...
1
vote
0answers
10 views

Similarity measure of lower and upper triangle matrix [closed]

Do you have any idea to create index regarding the similarity of lower and upper elements (i-jth element and j-i th element) of triangle matrix A? One way is given the index as Tij = A[ij] / A[ji] ...
1
vote
0answers
30 views

Similarity measure for time series

How can I recognize patterns with different sizes in a time-series? Imagine that I have a template pattern and I need to find that pattern in a symbolic representation of the time-series (stock market ...
2
votes
1answer
58 views

A valid distance metric for high dimensional data

I asked a question about forming a valid distance metric yesterday (Link1) and got some very good answer; however, I have got some more questions about forming a proper distance metric for high ...
1
vote
3answers
58 views

How to get a valid distance metric?

I have got a problem to devise a distance metric to get the similarity measurement of vectors. Someone suggested me to use dot product, which seems to me the same as the Cosine similarity metric; ...
0
votes
0answers
15 views

Correlation or similarity between response surfaces

Given the dataset A and B both containing observations (x, y) whereas x can be a vector. What are some possibilities of measuring the similarity or correlation between A and B? We can assume that ...
7
votes
2answers
128 views

A person repeatedly selects the two most similar items out of three. How to model/estimate a perceptual distance between the items?

A person is given three items, say pictures of faces, and is asked to pick out which two of the three faces are the most similar. This is repeated a large number of times with different combinations ...
3
votes
2answers
46 views

Is paired t test sufficient to show the two data sets are similar

Let me give the details of my problem setting, we have a learning algorithm that can take a collection of algebra problems and automatically generate similar ones. Of course, an important question to ...
0
votes
0answers
22 views

How to quantify the similarity between two samples using quartiles only?

I have several sets of samples I would like to compare. Each set is comprised of two samples, for which I only have the quartiles, min/max values and sample size for each sample. I would like to ...
0
votes
1answer
58 views

how to superimpose two matlab images rigidly transformed to perform a metrics

i got two MRI images on matlab, i need to perform an intensity based registration similarity metrics in order to get a registration. The problem is that, since i got some rigid transformation on one ...
0
votes
0answers
54 views

Two step cluster analysis and a binary matching coefficient

I want to commence a two-step cluster analysis, since the database I am conducting analysis on contains important metric as well as nominal values. => Question #1: Should the binary and the metric ...
0
votes
0answers
30 views

How to use Similarity Measure in K-nearest neighbor Classification?

I have a similarity measure just like cosine. How can i use that similarity measure in traditional k-nn classification? Please provide some literature review (research papers) details which i should ...
2
votes
1answer
51 views

Drop highly correlated items?

I have two IVs that are highly correlated with each other at 0.979 (Pearson) & 0.919 (Kendall's). IV1: Quality of response IV2: Quality of Technical Advice Sample Size: 252 Considering the ...
0
votes
0answers
74 views

Using relative frequency for Euclidean and cosine distance (dissimilarity)

How to calculate the Euclidean distance (dissimilarity) between two documents, e.g., D1 and D2 using relative frequency? Here is an example of both cosine and Euclidean distance between two ...
0
votes
0answers
81 views

Calculate Similarities between two arrays with different scales

In creating a content-based recommender, I have several binary measurements, combined with integer measurement values and I wish to compare the two vectors. For example, consider the following two ...
0
votes
1answer
107 views

kernels and similarity (in R)

I am trying fit different kernels to calculate similarity matrix in R. Here is example data - X matrix : ...
0
votes
0answers
28 views

Comparing similarity of two fingerprint or bitvector

I have a question that's two part. 1) The first part is that I have a bit vector or a fingerprint of a digital circuit where the each bit is high if a specific structure or component exists and zero ...
0
votes
0answers
11 views

Search for similar documents on growing term-base

Could you please recommend any approach (if it exists) for similar document search considering the following: It's necessary to provide term base explicitly. This is a dictionary of specific named ...
1
vote
3answers
40 views

Computing Image Similarity based on Color Distribution

Image Similarity based on Color Palette Distribution I am trying to compute similarity between two images based on their color palette distribution, let's say I have two sets of key value pairs as ...
0
votes
2answers
141 views

Excel: which products are most frequently ordered together? (clustering question)

I'd like to recruit your help in coming up with an Excel-based method to analyse a set of raw ordering data where each item is on its own row. So, in the data below, order 111 contains two part ...
0
votes
0answers
45 views

What is this problem called in machine learning research?

Given 2 sets of entities from 2 different classes described by properties $f_1...f_n$, any 2 entities from the 2 different classes together have a score: ${\rm Score}(c_1e_1,c_2e_1) = y$. How ...
1
vote
0answers
40 views

How to estimate similarity between several probability distributions?

I have several set of probability distributions. I want to reliably estimate consistency across distributions inside each set. Literature contains methods to compare two distributions: ...
0
votes
1answer
18 views

Similarity between two samples of spacialized data ignoring local fluctuations

I have data from a set of sensors, and would like to measure similarity between two samples of data ignoring local fluctuations. My problem is, my sensors are not regularly placed : some are quite ...
0
votes
0answers
39 views

Dissimilar to multiple points

I have a few points in multiple dimensions. I am able to compute similarity between those items (using, say Cosine distance). For example, ...
1
vote
1answer
54 views

Similarity between different length vectors containing related items

I have a vector (V1) with which I need to calculate the similarity of other vectors (ex V2,V3 ... ) which may be of different lengths. The different angle here is that the elements inside the vectors ...
2
votes
2answers
110 views

Similarity of time series

I try to find out the smallest window size for calculating statistical values on a stream. To illustrate my problem: I record the average car counts per brand on a street using different sliding ...
0
votes
0answers
207 views

Clustering communication patterns to detect multiple identities

I have a data set of communication patterns between chatting agents. Each agent can have multiple profiles or identities. I am interested in developing a way to investigate the similarity between ...
0
votes
0answers
28 views

Calculate similarity of waiting times of users

Let's say I have waiting times(seconds) of users in web pages. ...
1
vote
1answer
34 views

calculate Levenshtein Distance for web click stream data

I want to calculate Levenshtein Distance between to web click paths. I have a web page list around 500. ...
0
votes
0answers
32 views

What is the best test to compare pattern similarity in different condition?

I have several subjects, for each subject I have two measure (pre and post treatment) of several parameters, I have calculated a multivariate similarity measure (Mahalanobis distance) between each ...
3
votes
0answers
56 views

Using similarity matrix to measure diversity of a group

I wish to measure the "diversity" of a group of objects. Right now I'm using Euclidean distance to compute the similarity matrix between all the objects in the group. I'm searching for a measure of ...
2
votes
2answers
211 views

Building the connection between cosine similarity and correlation in R

According to some articles (e.g. here) correlation is just a centered version of cosine similarity. I use the following code to calculate the cosine similarity matrix of the column vectors of a matrix ...
4
votes
1answer
126 views

Finding similarity between the objects ( Actually how to justify the similarity of objects in mathematics form )

I have developed a system to trace the outlines of (images of) objects. Now I want to test whether two independent traces represent a common feature. Imagine two people (or machines) tracing the ...
0
votes
0answers
27 views

Similarity in a vector space model with skewed feature distribution

I want to compute the pairwise cosine similarity of items in a vector space of a very high dimensionality . My input matrix is very sparse, but the number of nonzero elements per item follows a very ...
1
vote
1answer
40 views

Similarity Coefficient and Geochemical Correlation

I have a set of around 160 samples from different sediment bodies, or stratigraphic units, which I am attempting to correlate using geochemical analysis of 25 elements for each sample, and a ...
2
votes
0answers
56 views

What is a good technique for grouping objects based on binary or dichotomous traits?

I have a set of objects each of which has a list of traits. Data on the traits is binary: an object has a trait or does not. The number of objects that I have is moderately greater than the number ...
0
votes
0answers
30 views

Converting a similarity to a dissimilarity [duplicate]

I am working on a clustering problem for which I have to manually choose the number of clusters. I have a visualization tool that helps me decide whether the clusters are good. In order to ...
4
votes
0answers
159 views

Compute Shannon entropy between every row of a large, sparse matrix

I have a sparse, binary matrix of user (rows) and items (columns). Each element of this matrix is either 0 or 1: ...
1
vote
0answers
82 views

Cosine similarity for a group of vectors

I am starting to work in R with the following case: 35 countries have scores between [0,1] in 120 dimensions and I need to show that there are differences in the way their scores distribute across ...
0
votes
2answers
221 views

Similarity measure between two variables

I want to find the similarity factor (some numerical value) between two variables. Example: row 1: 5.1, 3.5, 1.4, 0.2 rows 2: 4.9, 3.1, 1.5, 0.1 How to find similarity factor between these two ...
1
vote
1answer
147 views

Determining similar users from hierarchical clustering

I use hierarchical clustering to cluster users which are similar to each other based on a Jaccard coefficient. I have now coded a solution to extract similar users based on hierarchical clustering: ...
2
votes
0answers
34 views

How to calculate the similarity of two corpora (each of which contains a set of documents)?

I have two corpora for example, each of which contains a set of different documents, and each document are already represented as a vector of words in a certain way. The two corpora are small, only ...
0
votes
0answers
43 views

Learning from distance matrices

I have a task to build multi-task classification model based on distance (similarity) matrix only. They are already precalculated and no changes here can be applied. Can you, please, recommend me ...
0
votes
0answers
38 views

Dataset similarity measurement

Suppose: For each input data, I could obtain true result as well as experiment result from my algorithm, one example is The true result is A = {a, b, c}, ...
0
votes
2answers
67 views

Similarity measure between multiple distributions

To compare distributions, it is common to use box blots. I'm looking for a similarity measure that calculates whether distributions are the similar or not. Ideally, given that e.g. four ...
1
vote
1answer
185 views

Clarification needed about min/sim hashing + LSH

I have a reasonable understanding of the technique to detect similar documents consisting in first computing their minhash signatures (from their shingles, or n-grams), and then use an LSH-based ...
2
votes
0answers
565 views

How to get Bhattacharyya Distance in Excel (or Matlab, or R)

I have several histograms which I would like to compare to one reference histogram to see which one is the most similar to the reference in terms of the shape of the distribution. Kologorov-Smirnov ...
0
votes
2answers
363 views

How similar are my 2 data sets?

I am kind of stuck with an easy question: I have two data sets with experimental data. The data sets do not have the same size. I would like to show that these data sets are possibly coming from the ...
0
votes
0answers
23 views

How a problem of calculating a probability of two differently represented objects being the same is called?

I'm solving a task of matching (i.e., asserting that different "accounts" represent the same object) social network's profiles of users with their representation in a database of firms founders. The ...