The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
0answers
14 views

How to measure consistency or simiarity between two data sets?

I am working on a study that elicits priorities (weights) from experts on a set of alternatives using different methods. The snapshot below shows the resulting weights, which sum up to 1 for each ...
0
votes
0answers
16 views

Kolmogorov-Smirnov and Hellinger distances

I am comparing two distributions with these two methods and sometimes I find no correlation between them! How is it possible? Which one is more believable? I use the D statistic from the KS test and ...
0
votes
0answers
13 views

Ward's clustering with Gower's metric [duplicate]

I calculated Gower distance matrix with daisy(cluster) function in R and than applied K-medoids with pam(cluster) function. I tried for cluster number k=3,4,5,6...20. But average silhouettes were ...
0
votes
0answers
12 views

which distance for clustering

I've got 6000 reports that I've cleaned up. I've used 8 different steps to remove words of the reports. For each report, I've got a table of the following form: ...
0
votes
1answer
83 views

Gower distance with R functions; “gower.dist” and “daisy”

I have 9 numeric and 5 binary (0-1) variables, with 73 samples in my dataset. I know that the Gower distance is a good metric for datasets with mixed variables. I tried both daisy(cluster) and ...
1
vote
1answer
26 views

Test if paired data are more similar than non-paired data

I have a set of ten samples, comprised of five pairs of twins, and I have calculated the pairwise distances between all ten samples. The question I would like to answer with this data is: Are ...
2
votes
0answers
41 views

Probability that uniformly distributed points in a square region form a cluster

I have a known number of points N uniformly distributed in a square and I want to solve the expected number of clusters of points. I cluster is formed by a growing algorithm. Starting at a point p, ...
0
votes
0answers
40 views

Gower distance with R

I have 17 numeric and 5 binary (0-1) variables, with 73 samples in my dataset. I know that the Gower distance is a good metric for datasets with mixed variables. When I use daisy function in cluster ...
0
votes
0answers
11 views

Isolation by distance -data transformation

In population genetics a common analysis is to look for a correlation between genetic distance (e.g. FST) and geographic distance (km) using a scatterplot and linear regression. For this it seems a ...
0
votes
0answers
23 views

What is variance and co variance related to time series?

I'm trying to understand the Mahalanobis distance method which makes use of a covariance matrix. However i am not clear about the idea of variance and covariance with respect to time series. And also ...
0
votes
0answers
15 views

r-pnn, normalization and different distance measures for each variable

Since pnn is a NN that uses a Radial kernel to classify data, I think the distance measure is key and, in consequence, the normalization of the data. Am I right? How does pnn package calculate the ...
5
votes
3answers
135 views

Why are mixed data a problem for euclidean-based clustering algorithms?

Most classical clustering and dimensionality reduction algorithms (hierarchical clustering, principal component analysis, k-means, self-organizing maps...) are designed specifically for numeric data, ...
2
votes
1answer
81 views

How does the Gower distance calculate the difference between binary variables'?

I have 17 numeric and 5 binary (0-1) variables, with 73 samples in my dataset. I need to run a cluster analysis. I know that the Gower distance is a good metric for datasets with mixed variables. ...
1
vote
0answers
20 views

Unique matching for quantiles from one half of the density to a subset of the other half?

I am interested in finding the median absolute distance to quantiles. So, for $Q_\alpha$ the $0 \le \alpha \le 1$ quantile, I would like to find $Q_\gamma^*$ such that $Q_\gamma^*$ satisfies ...
0
votes
0answers
18 views

Want to findout satistical distance unsing another procedure except kullback liebler divergence

i want to find the distance between two pdf(pdf is calculated using kernel density estimator from two random data set of different size ) .Is there any alternative and efficent way to calculate ...
2
votes
1answer
52 views

Minimax space-filling design for 2 dimensions in practice

I think I understand the basic idea of a 2d minimax design. Given $n$ data points, choose locations for each point so that the maximum distance between anywhere in the input space and any of the $n$ ...
0
votes
0answers
52 views

Distance between two independent normal random variable

What is the PDF of $Z=\sqrt{(X-x_0)^2+(Y-y_0)^2}$ when X and y are i.i.d. zero mean normal random variable (i.e., $x\sim N(0,\sigma^2)$ and $x\sim N(0,\sigma^2)$)
3
votes
1answer
63 views

Euclidean distance with sparse and high dimension data

I have texts for a bunch of objects. From each text, I removed the stop words, and took each word as an attribute of the object. I then gave each word a rating based on sentiment analysis, so that the ...
1
vote
0answers
43 views

Average within-cluster distance using divisive clustering

I have to prove that the average within-cluster distance for 10 data points cannot increase when going from 1 cluster to 2 clusters (divisive clustering). Intuitively, it seems obvious that this is ...
0
votes
0answers
30 views

What is the relationship between naive Bayes and Mahalanobis distance

Recently, I found a code project which uses the Mahalanobis distance to compute Bayes value, but I don't know why you can do that. Second, as I know naive Bayes is based on the Bayes rule, and how ...
1
vote
0answers
35 views

How to compare the distances or divergence between two groups of datasets

If I have two groups of data sets. Each group has two arrays of empirical data. In the first group each array has, say, 50,000 data points, and in the second group each array has 3,000 data points. ...
0
votes
0answers
19 views

How to test differences in multiple pairwise distances? With mixed model?

I want to compare two set of variables: X1 = All the pairwise distances between individuals from group A and group ref R X2 = ALL the pairwise distances between individuals from group B and group ...
1
vote
0answers
30 views

Occupancy octree metrics (Kullback-Leibler)

As I'm currently working on scan matching for outdoor environments I was wondering about the best metric to compare two occupancy octrees (one resulted from the scan matching and one ground truth ...
1
vote
0answers
20 views

Partial correlations among three distance matrices

I am trying to test the hypothesis that related species should deviate more in niche space the more they overlap in geographic space. In other words, related species either forage similarly and don't ...
1
vote
1answer
54 views

Metric to compute structural similarity between two directed graphs

I'm working on a small project in which I try to compare directed a-cyclic graphs. Say I have (directed) three graphs: 1) ...
1
vote
1answer
21 views

Distribution of distances to an observation from the normal and the median of these distances

Given $x\sim \mathcal{N}(\mu=0, \sigma^2=1)$, the squared distances of the $x$ values to $\mu$ are distributed $\chi^2_1$. I am interested in the distribution of the squared distances to an arbitrary ...
0
votes
1answer
209 views

Mahalanobis distance in a hierarchical cluster analysis in SPSS

I am conducting a hierarchical cluster analysis in SPSS on my database with several neuropsychological and psychiatric variables. In my database, some of my variables (that is: two pairs of variables) ...
0
votes
1answer
41 views

Order of Matrix Operations in Mahalanobis Calculations

I'm teaching myself to translate equations to code after many years of letting my math skills atrophy, and am trying to do it on my own as much as possible. I've run into a couple of difficult ...
0
votes
2answers
101 views

Dynamic Time Warping for irregular time series

I have been reading a lot about Dynamic Time Warping (DTW) lately. I am very surprised that there is no literature at all on the application of DTW to irregular time series, or at least I could not ...
0
votes
0answers
107 views

R. function hclust, euclidean distances and cosines

My data is a table of cosines and I want to analyze it with hclust, which works on squared Euclidean distances. shall I do: d <- dist(mydata, method = "euclidean") fit <- hclust(d, ...
0
votes
0answers
17 views

Weighing a variable based on distance to a known date

In a bankruptcy model, you want to assign a higher weight to a variable as a big event date approaches (such as a company's quarterly earnings announcement date) and you reverse this weighing as you ...
2
votes
2answers
134 views

How to visualize the comparison of 3 different types of distances among objects

I need to calculate the difference between six time series in three ways: Time Series are: Kamel, Dumper, Graben, Traktor, Generator Methods are: Euclidean distance, Manhattan distance and maximum ...
1
vote
0answers
27 views

Representing a distance matrix in the plane [duplicate]

I've worked with observations as vectors with both continuous and categorical variables. In both cases one can use dimensionality reduction techniques such as PCA (in the latter case through ...
1
vote
1answer
69 views

Extract (ultrametric) distances from hclust or dendrogram

How can the matrix of (ultrametric) distances be extracted from the result of hclust (or a dendrogram in general) in R? The ...
0
votes
0answers
114 views

Computing a distance matrix between multiple multivariate time series

This question has also been asked on stackoverflow.com. Yet my aim is to ask for efficiency gains on the aforementioned platform. My aim here is the correctness of my approach. I am trying to cluster ...
0
votes
0answers
39 views

Dissimilar to multiple points

I have a few points in multiple dimensions. I am able to compute similarity between those items (using, say Cosine distance). For example, ...
1
vote
1answer
34 views

calculate Levenshtein Distance for web click stream data

I want to calculate Levenshtein Distance between to web click paths. I have a web page list around 500. ...
0
votes
0answers
40 views

How to test the significance of clusters?

How can one test the significance of the clusters obtained after a clustering procedure? Are there separate tests for the distance/similarity/dissimilarity measure used to get the distance matrix and ...
7
votes
3answers
2k views

Calculate the Kullback-Leibler Divergence in practice?

I am using KL Divergence as a measure of dissimilarity between 2 $p.m.f.$ $P$ and $Q$. $$D_{KL}(P||Q) = \sum_{i=1}^N \ln \left( \frac{P_i}{Q_i} \right) P_i$$ $$=-\sum P(X_i)ln\left(Q(X_i)\right) + ...
3
votes
0answers
56 views

Using similarity matrix to measure diversity of a group

I wish to measure the "diversity" of a group of objects. Right now I'm using Euclidean distance to compute the similarity matrix between all the objects in the group. I'm searching for a measure of ...
1
vote
0answers
80 views

PDF for net displacement of bivariate normal X and Y

this is my first post on StackExchange so I hope I'm posting in the right place. I'm trying to derive the correct probability density function for the net displacement of random variables X and Y ...
2
votes
1answer
81 views

Distribution of distance from center of sample group

We have a bivariate normal process where $X, Y \sim N(0, \sigma)$, with no covariance. (For convenience we can assert that $\sigma = 1$, or that we have a good estimate for its value.) What is the ...
1
vote
1answer
110 views

Problem with estimating probability using the multivariate Gaussian

I'm working on a problem where I need to find the probability of a given data sample belonging to a give class using the Bayes Theorem for classification. From everything I've been able to find so ...
-1
votes
1answer
89 views

Cluster with distance threshold in R

I'd like to get clusters with a maximum inner distance threshold. Now I use hc <- hclust(d) and cutree(hc, numofclasses). ...
1
vote
0answers
46 views

Average minimum distance between two random vectors

Let $\mathbf{y_1} =\begin{bmatrix}g_1x_1 & g_2x_1 & \dots & g_Nx_1 \end{bmatrix}$ and $\mathbf{y_2} = \begin{bmatrix} f_1x_2 & f_2x_2 & \dots & f_Nx_2\end{bmatrix}$. All the ...
2
votes
1answer
123 views

Multidimensional Scaling “eurodist”

I have a question regarding Multidimensional Scaling. I used the dataset eurodist from the package datasets to generate a 2 ...
0
votes
0answers
10 views

Too Large Values with Assembled Distance Transform

I am trying to apply ADT as a distance between two images or their DCT coefficents. The ADT is given as (image taken from "Bidirectional PCA with assembled matrix distance metric for image recognition ...
0
votes
0answers
47 views

How genetic beta-diversity reflects traditional beta-diversity?

Im trying to figure out how betadisper {vegan, R}, and more specifically how the 'average distance to median' relates to betadiversity in a more traditional sense. betadisper calculates the variance ...
1
vote
1answer
216 views

Normalized cross correlation vs Euclidean distance in template matching

What is the difference between normalized cross-correlation and Euclidean distance in pattern recognition? -- especially if we want to do recognition with template matching. I understand about ...
0
votes
1answer
26 views

Distance Transform In Image?

I understand how to compute Distance Transform for BW image In BW image we can calculate the distance of the pixel with non zero pixel value using Eucledian Distance. But I dont undertand how to ...