3
$\begingroup$

When calculating moments of probability distributions, what would motivate you to take the moment about the mean (called "central moment") versus the standard moment about the origin?

$\endgroup$
2

1 Answer 1

3
+25
$\begingroup$

These uncentered moments are sometimes called "raw" or "crude" moments: https://mathworld.wolfram.com/RawMoment.html

One practical difference between centered moments and uncentered (raw) ones is their estimation from data. For example, estimating $E[X^2]$ is trivially done in an unbiased manner via: $\frac{1}{n} \sum_i^n x_i^2$. However estimating the 2nd centered moment, ie. $\text{Variance}[X]$, involves first estimating the expectation to do the centering. To estimate the variance in an unbiased manner, one has to account for the fact that the expectation was also estimated from data, leading to a subtle difference in the denominator term: why sample variance has has n-1 in the denominator?

The raw moments are intimately related to the Characteristic function and Moment-generating function of the distribution: https://en.wikipedia.org/wiki/Characteristic_function_(probability_theory)#Moments

Characteristic functions are very useful for studying theoretical properties of distributions, cf: What is the purpose of characteristic functions?

Similar representations of distributions like characteristic functions have many practical uses in Machine learning: https://en.wikipedia.org/wiki/Kernel_embedding_of_distributions

Regarding centered or raw moments, it is not the case that one should inherently prefer one over the other, it all depends on what you want to use them for. The centered moments have more common uses than the raw moments. For instance, the second centered moment is the variance, which used to quantify the spread of a distribution. The third centered moment (technically a normalized version thereof) is the skewness, which is commonly used to quantify the lopsidedness of a distribution (how asymmetric it is). The fourth centered moment is the kurtosis, which is commonly used to quantify how heavy-tailed a distribution is.

Centered moments are useful to measure properties of distributions in a location-invariant manner. Random variable $X$ and $X + c$ (for any constant $c$) have the same centered moments. Also the $k$-th centered moment of $c \cdot X$ is equal to $c^k$ times the $k$-th centered moment of $X$. Finally for independent random variables $X$ and $Y$, the $k$th moment of $X+Y$ is equal to the $k$th moment of $X$ + the $k$th moment of $Y$ -- but only for $k = 1, 2, or 3$ (not higher moments).

$\endgroup$
3
  • $\begingroup$ (Welcome to CV!) Thanks for your reply, you provide a good overview of how the raw and centered moments differ. If I'm understanding correctly, you suggest the raw moments are to be preferred over centered moments, though I think the OP had asked why/when the latter are (or should be) preferred over the former. $\endgroup$
    – psyguy
    Commented Jan 6, 2023 at 20:56
  • 1
    $\begingroup$ @psyguy yes thank you, let's get some more answers $\endgroup$ Commented Jan 6, 2023 at 21:17
  • $\begingroup$ updated my answer to reflect the advantages of centered moments over raw moments. I originally thought the question was to list some advantages of raw moments, since centered moments are encountered much more commonly. $\endgroup$ Commented Jan 7, 2023 at 5:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.