Skip to main content
2 of 5
deleted 1 character in body
Nick Cox
  • 59.5k
  • 8
  • 136
  • 212

The integral of this area, i.e. $$\int_x \lvert F(x) - G(x)\rvert \,\mathrm{d}x,$$ is known as the 1-Wasserstein distance, the 1-Kantorovich distance, or the "earth-mover's distance." It is quite a reasonable distance between probability distributions, which is easy to compute between one-dimensional distributions based on their cdfs.

For multivariate distributions, there is a natural extension (not based on CDFs, which become hard to work with), generally thought of within the field of optimal transport. You can think of it this way: think of each density function as a pile of dirt. The amount of dirt that you need to move to transform one density into another is exactly this distance. This leads to the name of "earth-mover's distance." The traditional way to estimate this distance from samples is by directly computing this transportation problem with a linear program, though there are more recent fast approximations.

The beautiful Kantorovich-Rubinstein duality also applies to this distance, which this year has led to an explosion of interest in the Wasserstein distance among the deep learning community, via this paper which uses it for generative modeling. The distance has also been popular in computer vision applications for decades.

Danica
  • 25.2k
  • 2
  • 76
  • 140