18
$\begingroup$

Mostly theoretical question. Are there any examples of non-normal distributions that has first four moment equal to those of normal? Could they exist in theory?

$\endgroup$
28
$\begingroup$

Yes, examples with skewness and excess kurtosis both zero are relatively easy to construct. (Indeed examples (a) to (d) below also have Pearson mean-median skewness 0)

(a) For example, in this answer an example is given by taking a 50-50 mixture of a gamma variate, (which I call $X$), and the negative of a second one, which has a density that looks like this:

dgam 2.3

Clearly the result is symmetric and not normal. The scale parameter is unimportant here, so we can make it 1. Careful choice of the shape parameter of the gamma yields the required kurtosis:

  1. The variance of this double-gamma ($Y$) is easy to work out in terms of the gamma variate it's based on: $\text{Var}(Y)=E(X^2)=\text{Var}(X)+E(X)^2=\alpha+\alpha^2$.

  2. The fourth central moment of the variable $Y$ is the same as $E(X^4)$, which for a gamma($\alpha$) is $\alpha(\alpha+1)(\alpha+2)(\alpha+3)$

As a result the kurtosis is $\frac{\alpha(\alpha+1)(\alpha+2)(\alpha+3)}{\alpha^2(\alpha+1)^2}=\frac{(\alpha+2)(\alpha+3)}{\alpha(\alpha+1)}$. This is $3$ when $(\alpha+2)(\alpha+3)=3\alpha(\alpha+1)$, which happens when $\alpha=(\sqrt{13}+1)/2\approx 2.303$.


(b) We could also create an example as a scale mixture of two uniforms. Let $U_1\sim U(-1,1)$ and let $U_2\sim U(-a,a)$, and let $M=\frac12 U_1+\frac12 U_2$. Clearly by considering that $M$ is symmetric and has finite range, we must have $E(M)=0$; the skewness will also be 0 and central moments and raw moments will be the same.

$\text{Var}(M)=E(M^2)=\frac12\text{Var}(U1)+\frac12\text{Var}(U_2)=\frac16[1+a^2]$.

Similarly, $E(M^4)=\frac{1}{10} (1+a^4)$ and so the kurtosis is $\frac{\frac{1}{10} (1+a^4)}{[\frac16 (1+a^2)]^2}=3.6\frac{1+a^4}{(1+a^2)^2}$

If we choose $a=\sqrt{5+\sqrt{24}}\approx 3.1463$, then kurtosis is 3, and the density looks like this:

enter image description here


(c) here's a fun example. Let $X_i\stackrel{_\text{iid}}{\sim}\text{Pois}(\lambda)$, for $i=1,2$.

Let $Y$ be a 50-50 mixture of $\sqrt{X_1}$ and $-\sqrt{X_2}$:

enter image description here

by symmetry $E(Y)=0$ (we also need $E(|Y|)$ to be finite but given $E(X_1)$ is finite, we have that)

$Var(Y)=E(Y^2)=E(X_1)=\lambda$

by symmetry (and the fact that the absolute 3rd moment exists) skew=0

4th moment: $E(Y^4) = E(X_1^2) = \lambda+\lambda^2$

kurtosis = $\frac{\lambda+\lambda^2}{\lambda^2}= 1+1/\lambda$

so when $\lambda=\frac12$, kurtosis is 3. This is the case illustrated above.


(d) all my examples so far have been symmetric, since symmetric answers are easier to create -- but asymmetric solutions are also possible. Here's a discrete example.

enter image description here


As you see, none of these examples look particularly "normal". It would be a simple matter to make any number of discrete, continuous or mixed variables with the same properties. While most of my examples were constructed as mixtures, there's nothing special about mixtures, other than they're often a convenient way to make distributions with properties the way you want, a bit like building things with Lego.

This answer gives some additional details on kurtosis that should make some of the considerations involved in constructing other examples a little clearer.


You could match more moments in similar fashion, though it requires more effort to do so. However, because the MGF of the normal exists, you can't match all integer moments of a normal with some non-normal distribution, since that would mean their MGFs match, implying the second distribution was normal as well.

$\endgroup$
-4
$\begingroup$

Good points are made by Glen_b. I would only add consideration of the Dirac Delta function as additional grist for the mill. As Wikipedia notes, "The DDF is a generalized function, or distribution, on the real number line that is zero everywhere except at zero, with an integral of one over the entire real line" with the consequence that all higher moments of the DDF are zero.

Paul Dirac applies it to quantum mechanics in his 1931 book The Principles of Quantum Mechanics but it's origins date back to Fourier, Lesbesgue, Cauchy and others. The DDF also has physical analogues in modeling the distribution, e.g., of the crack of a bat hitting a baseball.

$\endgroup$
  • 1
    $\begingroup$ What has this to do with the question? $\endgroup$ – kjetil b halvorsen Jun 1 '15 at 13:25
  • 2
    $\begingroup$ The question is explicit about making the "first four moment[s] equal to those of [a] normal [distribution]". You haven't a hope of even matching the second central moment when you use a delta distribution. $\endgroup$ – whuber Jun 1 '15 at 15:58
  • 3
    $\begingroup$ Perhaps you can give an example where you match moments of a standard normal (mean 0, variance 1, $E[(X-\mu)^3]=E(X^3)=0$ and $E[(X-\mu)^4]=E(X^4)=3$). If you do that, it will answer the questions being raised and clarify your point. $\endgroup$ – Glen_b Jun 1 '15 at 16:45
  • 3
    $\begingroup$ @A. Donda: Excess kurtosis is the 4th standardized moment about the mean minus 3, i.e. $\mathrm{E}(X - \mathrm{E} X)^4 / (\mathrm{E}(X - \mathrm{E} X)^2)^2$, so I don't think you can say it's -3 in the case of Dirac's delta function - rather it's undefined, as the variance is zero. $\endgroup$ – Scortchi - Reinstate Monica Jun 1 '15 at 18:18
  • 2
    $\begingroup$ @Mike Hunter: I think the questions in the title & body are equivalent: once you have a distribution with defined skewness & excess kurtosis both equal to zero, matching mean & variance to any Gaussian you want is just shifting & stretching. I stress defined because both skewness & kurtosis are standardized moments, so the Dirac delta function doesn't have them. $\endgroup$ – Scortchi - Reinstate Monica Jun 1 '15 at 18:51

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.