Skip to main content
replaced http://stats.stackexchange.com/ with https://stats.stackexchange.com/
Source Link

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvaluesMaking sense of principal component analysis, eigenvectors & eigenvalues

UPDATE:

From Wikipedia intuitive explanation was:

"The Mahalanobis distance is simply the distance of the test point from the center of mass divided by the width of the ellipsoid in the direction of the test point."

So is $C^{-1}$ the width of the ellipsoid in the direction of the test point? I mean this distance I can understand: $$\displaystyle\frac{\textbf{x}-\textbf{u}}{\sigma}$$

But this distance confuses me...:/

$$\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

UPDATE:

From Wikipedia intuitive explanation was:

"The Mahalanobis distance is simply the distance of the test point from the center of mass divided by the width of the ellipsoid in the direction of the test point."

So is $C^{-1}$ the width of the ellipsoid in the direction of the test point? I mean this distance I can understand: $$\displaystyle\frac{\textbf{x}-\textbf{u}}{\sigma}$$

But this distance confuses me...:/

$$\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

UPDATE:

From Wikipedia intuitive explanation was:

"The Mahalanobis distance is simply the distance of the test point from the center of mass divided by the width of the ellipsoid in the direction of the test point."

So is $C^{-1}$ the width of the ellipsoid in the direction of the test point? I mean this distance I can understand: $$\displaystyle\frac{\textbf{x}-\textbf{u}}{\sigma}$$

But this distance confuses me...:/

$$\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Post Closed as "off topic" by whuber
added 308 characters in body
Source Link
jjepsuomi
  • 5.9k
  • 13
  • 41
  • 52

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

UPDATE:

From Wikipedia intuitive explanation was:

"The Mahalanobis distance is simply the distance of the test point from the center of mass divided by the width of the ellipsoid in the direction of the test point."

So is $C^{-1}$ the width of the ellipsoid in the direction of the test point? I mean this distance I can understand: $$\displaystyle\frac{\textbf{x}-\textbf{u}}{\sigma}$$

But this distance confuses me...:/

$$\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

UPDATE:

From Wikipedia intuitive explanation was:

"The Mahalanobis distance is simply the distance of the test point from the center of mass divided by the width of the ellipsoid in the direction of the test point."

So is $C^{-1}$ the width of the ellipsoid in the direction of the test point? I mean this distance I can understand: $$\displaystyle\frac{\textbf{x}-\textbf{u}}{\sigma}$$

But this distance confuses me...:/

$$\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Mahanalobis -> Mahalanobis, two other minor edits
Source Link

The derivation of the MahanalobisMahalanobis distance formula

I recently asked about the MahanalobisMahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahanalobis formulaMahalanobis distance. So my question is: "How does one derive the formula for MahanalobisMahalanobis distance?"

Why does the formula have the form  :

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

The derivation of the Mahanalobis distance formula

I recently asked about the Mahanalobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahanalobis formula. So my question is: "How does one derive the formula for Mahanalobis distance?"

Why does the formula have the form  :

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

The derivation of the Mahalanobis distance formula

I recently asked about the Mahalanobis distance and I got pretty good answers in this post:

Bottom to top explanation of the Mahalanobis distance?

I think I got the idea, but what I still felt missing was the derivation of the formula for the Mahalanobis distance. So my question is: "How does one derive the formula for Mahalanobis distance?"

Why does the formula have the form:

$$D(\textbf{x},\textbf{y})=\sqrt{ (\textbf{x}-\textbf{y})^TC^{-1}(\textbf{x}-\textbf{y})} $$

Could perhaps someone give analogous derivation as user @sjm.majewski gave on Principal component analysis on the link below:

Making sense of principal component analysis, eigenvectors & eigenvalues

Source Link
jjepsuomi
  • 5.9k
  • 13
  • 41
  • 52
Loading