Questions tagged [mahalanobis]
The mahalanobis tag has no usage guidance.
52
questions
1
vote
0
answers
28
views
Mahalanobis Distance critical alpha cutoff [closed]
I have two predictors and five dependent variables. I'm trying to figure out what the critical alpha cutoff for Mahalanobis distance is for a model with 5 DVs to check for assumption of multivariate ...
- 11
0
votes
1
answer
28
views
All Weights Are "1" For Mahalanobis Nearest-Neighbor Matching
When generating weights using nearest-neighbor matching with Mahalanobis distance, all of my weights for each treated and non-treated unit are "1". Below is my syntax using the ...
- 427
2
votes
1
answer
31
views
Merits of different matching & weighting methods for multiple treatments
I have three land use classes (natural farming, chemical farming, and forest) and would like to compare the densities of different bird species between them. I would like to get the ATE (I think).
I ...
- 21
0
votes
0
answers
91
views
Testing differences between groups using PCA / mahalanobis distance
I would appreciate any thoughts on the below problem, as well as recommended reading for PCA, mahalanobis distance, and hypothesis testing as it pertains to the below vignette!
I'm dealing with some ...
- 1
0
votes
0
answers
37
views
Mahalanobis distance for a vector with (also) angular data
I have a vector of data that is composed of 9 values:
position in 3d
orientation in 3d
size in 3d.
Obviously, angles are "circular" values, that is 359deg is near to 1deg, but $359 - 1 = ...
- 1
0
votes
0
answers
35
views
Is it possible to apply the kernel trick to a "mahalnobis distance learner" such as GLS?
1.https://arxiv.org/pdf/0804.1441.pdf
2.https://www.sciencedirect.com/science/article/abs/pii/S0925231210001165
These papers describe kernelizing a mahalanobis distance learner.
I am interested in ...
user318514
1
vote
1
answer
27
views
in built Mahalanobis distance function gives different result
i want to calculate mahalanobis distance, from the formula and also theoretical explanation given here
...
- 775
-1
votes
1
answer
114
views
How to (dis)prove Mahalanobis $ d^2 $ is non decreasing?
I have been studying multivariate analysis and hypothesis testing , and came across this question in back exercise
Define Mahalabonis measure of distance squared between
two populations with a common ...
- 376
1
vote
0
answers
29
views
Running several hierarchical linear regressions, all have the same Mahalanobis Distance. Is this weird?
As the title says I've run several hierarchical linear regressions on SPSS and I've found that all 6 of them have the same Mahalanobis Distance. I'm wondering if this is a normal thing to happen or ...
- 11
6
votes
1
answer
378
views
Why does univariate Mahalanobis distance not match z-score?
I am using Mahalanobis distance for outlier detection. Sometimes my dataset only has 1 feature, sometimes many more. I believe the univariate Mahalanobis distance should be equal to the z-score of the ...
- 329
-1
votes
0
answers
43
views
Gaussian distribution, Mahlanobis distance, probability [closed]
**Suppose we have a set of b variables which have x and y coordinates (bx1 by1, bx2 by2,...,bxN byN) each of which have a gaussian distribution. we also have somepoints, suppose (Ux1 Uy1, Ux2 Uy2, ......
0
votes
0
answers
16
views
Distribution comparison using mahalanobis distance
I'm struggling with how to properly implement the methods described within this link. I have a basic understanding of the math involved but as far as using python to generate results I'm lost. The ...
- 101
2
votes
2
answers
313
views
Confusion on calculating Mahalanobis distance between a point and a cluster
I am slightly confused as to how you calculate Mahalanobis distance given a set of data. I have tried asking my tutor for help but he does not seem interested in helping what so ever and I am ...
- 143
0
votes
0
answers
166
views
understanding the calculation of the mahalanobis distance
I am working with biological measurements ( of control/reference samples + different experimental conditions). Single measurements might correlate.
So I have a set of parameters/measurement which are ...
- 121
1
vote
0
answers
117
views
Distance metric that is robust to collinearity
I'm trying to find a distance metric that takes into account the correlation between vectors. That is, suppose we have matrix $M$ of dimensions $n \times k$, and we take the pairwise distance between ...
- 251
4
votes
1
answer
119
views
Multivariate Chebyshev's inequality with Mahalanobis distance
In Chebyshev's inequality, we can generalize the 68-95-99.7 rule from normal distributions to bound how much density is within a certain number of standard deviations from the mean.
$$
P\big(
\big\...
- 46.6k
0
votes
0
answers
51
views
Deducing $L^1$ Boundary from Mahalanobis Boundary
Assume maximum likelihood estimators $a,b$ of size $p$, with corresponding estimated covariance matrices $V^a,V^b$. In fact $a,b$ are two regression coefficient vectors.
Denote $q=a-b$ the vector of ...
- 2,676
2
votes
0
answers
158
views
About the calculation of covariance matrix in mahalanobis distance: How $W^TW$ is equal to the covariance matrix? [closed]
I was reading about deep metric learning (from here) and came across the mahalanobis distance. I understood why we can not use euclidean distance if the distribution is not isotropic (the covariance ...
- 141
0
votes
0
answers
124
views
Mahalanobis vs centering / standard deviations
Is there a difference whether to use a Mahalanobis distance or transform the data via centering (and normalization) when you are interested in calculating distances?
This means, if you are interested ...
- 2,939
1
vote
0
answers
45
views
Distance defined by second moment, akin to Mahalanobis distance?
In ordinary linear regression ($c=0$) and ridge regression ($c > 0$), for design matrix $X$ with dimensions $N$ observations by $D$ dimensions, the $N \times N$ hat matrix is given by:
$$H = X (X^T ...
- 741
3
votes
1
answer
327
views
What is the covariance matrix of the normal order statistics?
I would like to test if a sample comes from a standard normal distribution. I want to do that by sorting the sample values, and measuring the Mahalanobis distance to the expected order statistics from ...
- 131
0
votes
0
answers
14
views
Why is the covariance matrix inverted in the definition of the Mahalanobis distance? [duplicate]
I'm on my first course on data science, and I encountered the Mahalanobis distance for the first time. It was mentioned that intuitively, what it does is that it corrects for the fact that some ...
- 101
0
votes
0
answers
30
views
How to find 'influential points' in multivariate data with weak covariance
Part-1: I have used PCA and Mahalanobis distance to find outliers. But in both cases, only the highest or lowest values are detected as outliers. I am looking for a way that any data point that does ...
1
vote
1
answer
255
views
Mahalanobis Distance question in R
I have a question when calculating Mahalanobis Distance using R.
For the Mahalanobis distance function below:
mahalanobis(x, **center**, cov, inverted = FALSE, ...)
...
- 15
0
votes
0
answers
33
views
Is negative Mahalanobis distance proportional to log probability?
Is the following statement true? I was sure it was, but I was told by someone else that it is not.
$$
p(\mathbf{x}_i | y_i) = \frac{1}{2\pi^{\frac{D}{2}} |\mathbf{\Sigma}_c|^{\frac{1}{2}} } e^{ -\frac{...
- 700
0
votes
0
answers
20
views
Effect of correlation in matching
What is the effect of correlations among observed covariates or between observed and unobserved covariates on the quality of matching, when matching iss done using
Propensity score
(Euclidian/...
- 515
1
vote
1
answer
312
views
Is there an intuition about the matrix operations in the exponent of the multivariate normal distribution?
In the exponent of the multivariate distribution, there are 2 vectors and a square matrix multiplied together to get a scalar result:
$$(\mathbf{x} - \mu)^{\text{T}}\Gamma^{-1}(\mathbf{x} - \mu)$$
...
- 11
2
votes
3
answers
278
views
How to find the variance(s) of a bivariate normal density such that 95% of the mass is within a certain radius from the mean defined by a point A?
I would like to find the variance of a bivariate normal density (BND), centered at the mean M, such that 95% of its mass is within a certain radius, which depends on the position of a point, A.
(Note: ...
- 290
10
votes
2
answers
7k
views
What are the pros and cons of using mahalanobis distance instead of propensity scores in matching
I learned about this option of using mahalanobis distance instead of PS to do matching from the matchit() function in R. It seems a more nonparametric approach. Could you state its pros and cons and ...
- 547
0
votes
0
answers
180
views
Mahalanobis distance to detect multivariate outliers [duplicate]
I have to detect outliers on 3 variables. On the internet I found the mahalanobis distance but I understood I can use it only on multivariate normally distributed data, and my data isn't. So, do you ...
- 1
0
votes
0
answers
351
views
Covariance Matrix Decomposition - Data Decorrelation
So I recently found out about Mahalanobis distance. Given a r.v $x$ in N-dimensional space, an associated metric is defined by
$$M(x) = \sqrt{(x-\mu)^T S^{-1}(x-\mu)}$$
where $\mu$ and $S$ are mean ...
- 1,749
0
votes
1
answer
92
views
When running a multiple regression, are both dependent and independent variables scanned for outliers?
I want to run a multiple regression analysis using SPSS. I have used the Mahalanobis d square method to find outliers. However my question is, do I add the dependent variable to the list of ...
2
votes
1
answer
148
views
How to determine an appropriate "closeness" threshold when matching for causal inference?
Say I have a [yes/no] treatment variable (e.g. the customer complained about their order) and I want to estimate the causal impact of this "treatment" on the average customer's future spend. ...
- 311
3
votes
2
answers
262
views
direction of outlier detected by the Mahalanobis distance
Mahalanobis distance provides a value that might be used for the detection of outliers. My question: how to calculate the direction of the outlier (as a vector)?
A simple answer would be to use the ...
- 330
1
vote
1
answer
664
views
Anomaly detection using Mahalanobis distance
I am using Mahalanobis distance to identify outliers. I am training using kind of one class classification,by training only on positive samples and trying to predict negative samples using distance ...
- 13
1
vote
1
answer
39
views
Detect outliers / detect classes
Currently I have a dataset that contains several products with different prices and quantities. My goal is to detect if the given product was sold as a package or as a unit and I have used the ...
- 111
0
votes
1
answer
595
views
Mahalanobis Distance for Continuous and Ordinal Covariates
My dataset of home sales includes covariates such as square_feet which are continuous and others like num_bedrooms which are in <...
- 125
2
votes
1
answer
222
views
Why does this formula produce $p_{2}$ probabilities for Mahalanobis distances?
At the IBM website it is written that
The p1 probabilities are standard probabilities of an observation from
a multivariate normal distribution being that far or further from the
centroid, ...
0
votes
0
answers
60
views
Equivalence between Mahalanobis distance and PCA (mathematical proof) [duplicate]
From this article and this post it emerges the strong connection between Mahalanobis distance and PCA. In particular in the first article I reference it says:
" the squared Mahalanobis distance is ...
- 1,140
0
votes
1
answer
276
views
Discordance between various methods of multivariate outliers detection
Here is a small "toy example" dataset, with 15 individuals described by 6 variables (this is R language):
...
- 289
3
votes
2
answers
2k
views
Understanding the R stats mahalanobis() function's Output
An acquaintance recommended I use the Mahalanobis distance on my data instead of Euclidean, Manhattan, etc.
I tried using the mahalanobis() function in the R stats package on a data matrix with N ...
- 545
2
votes
0
answers
101
views
Determine outliers for robust Mahalanobis distance
I want to apply a robust mahal distance and found an implementation in scikit.
but there is the number of outliers already given in advance. For me, who wants to find out the number of outliers, this ...
- 2,939
5
votes
2
answers
422
views
Something like Mahalanobis distance when the copula is not Gaussian
Mahalanobis distance accounts for different variances of the marginal variables and correlations between the marginal variables. However, there is an implicit (maybe explicit) assumption that ...
- 46.6k
1
vote
0
answers
670
views
Mahalanobis distance between 2 points doesn't work when covariance matrix has values close to 0 [duplicate]
I am working on a project where I am trying to replicate a randomized experiment from an observational study data, using Mahalanobis distance matching to ensure that the control and treated groups are ...
- 537
8
votes
2
answers
2k
views
Is there a version of the Mahalanobis distance for matrices?
I'm working on a computer vision problem and I want to use the Mahalanobis distance to cluster image patches (2D matrices having the same dimensions). I haven't been able to find any generalisation up ...
- 517
1
vote
0
answers
108
views
How can I use factor analysis to identify variables that contribute most to Mahalanobis distance?
I have 400 samples chemically analysed for 48 elements. Some elements are correlated. My goal is to identify outliers in a multivariate space, samples that are unique in their composition. I compute ...
- 11
1
vote
0
answers
1k
views
Distribution of the Mahalanobis distance between two samples from a Gaussian distribution
Let $\mathbf{X}=(X_1,\dots,X_p)\sim\mathcal{N}(\mu,\Sigma)$ be a Gaussian random vector. We all know that
$$d^2(\mathbf{X},\mu) = (\mathbf{X}-\mu)^T\Sigma^{-1}(\mathbf{X}-\mu) $$
has a $\chi^2_p-$...
- 16.7k
1
vote
0
answers
1k
views
assumptions to compute mahalanobis distance
Which are the assumptions to compute the Mahalanobis distance between two groups? Do all the variables of the two groups be normal distributed?
- 509
2
votes
2
answers
7k
views
Mahalanobis Distances Critical Values (Chi-Squared?)
Say I work out the mahalanobis distance 'D' to measure the separation between two objects (which aren't normally distributed).
Say I now want to use 'D' against some critical values to decide if it's ...
Yesiifi
3
votes
0
answers
152
views
Mahalanobis Distance - Geometric Place
Given a matrix $\mathbb{X}$ of 20 elements, representing 20 observation of a 5-variable normal, I was asked to find the Sample Mean Vector and Sample variance matrix and to find the geometric place of ...
- 1,208