10
$\begingroup$

I have recently realised that there are differences in the kurtosis values provided by SPSS and Stata.

See http://www.ats.ucla.edu/stat/mult_pkg/faq/general/kurtosis.htm

My understanding is that the interpretation of same would therefore be different.

Any advice on how to deal with this?

$\endgroup$
  • $\begingroup$ I knew about the first two formulas and it's pretty easy to distinguish those; I hadn't seen that third formula. $\endgroup$ – Peter Flom - Reinstate Monica Jun 14 '13 at 10:54
9
$\begingroup$

The three formulas

Three formulas for the kurtosis are generally used by different programs. I will state all three formulas ($g_{2}$, $G_{2}$ and $b_{2}$) and programs that use them.

The first formula and the typical definition used in many textbooks is (this is the second formula in the link you've provided) $$ g_{2}=\frac{m_{4}}{m_{2}^{2}} $$ where $m_{r}$ denotes the sample moments:

$$ m_{r}=\frac{1}{n}\sum(x_{i}-\bar{x})^{r} $$

Sometimes, a correction term of -3 is added to this formula so that a normal distribution has a kurtosis of 0. The kurtosis formula with a term of -3 is called excess kurtosis (the first formula in the link you've provided).

The second formula is (used by SAS, SPSS and MS Excel; this is the third formula in the link you've provided)

$$ G_{2} = \frac{k_{4}}{k_{2}^{2}}= \frac{n-1}{(n-2)(n-3)}\left[(n+1)g_{2}+6\right] $$

where $g_{2}$ is the kurtosis as defined in the first formula.

The third formula is (used by MINITAB and BMDP) $$ b_{2}=\frac{m_{4}}{s^{4}}-3=\left(\frac{n-1}{n}\right)^{2}\frac{m_{4}}{m_{2}^{2}}-3 $$

where $s^2$ is the unbiased sample variance:

$$ s^2=\frac{1}{n-1}\sum(x_{i}-\bar{x})^2 $$

In R the kurtosis can be calculated using the kurtosis function from the e1071 package (link here). The option type determines which one of the three formulas is used for the calculations (1=$g_{2}-3$, 2=$G_{2}$, 3=$b_{2}$).

These two papers discuss and compare all three formulas: first, second.

Summary of the differences between the formulas

  1. Using $g_{2}$, a normal distribution has a kurtosis value of 3 whereas in the formulas involving a correction term -3 (i.e. $G_{2}$ and $b_{2}$), a normal distribution has an excess kurtosis of 0.
  2. $G_{2}$ is the only formula yielding unbiased estimates for normal samples (i.e. the expectation of $G_{2}$ under normality is zero, or $\mathbb{E}(G_{2})=0$).
  3. For large samples, the difference between the formulas are negligible and the choice does not matter much.
  4. For small samples from a normal distribution, the relation of the three formulas in terms of the mean squared errors (MSE) is: $\operatorname{mse}(g_{2})<\operatorname{mse}(b_{2})<\operatorname{mse}(G_{2})$. So $g_{2}$ has the smallest and $G_{2}$ the largest (although only $G_{2}$ is unbiased). That is because $G_{2}$ has the largest variance of the three formulas: $\operatorname{Var}(b_{2})<\operatorname{Var}(g_{2})<\operatorname{Var}(G_{2})$.
  5. For small samples from non-normal distributions, the relation of the three formulas in terms of bias is: $\operatorname{bias}(G_{2})<\operatorname{bias}(g_{2})<\operatorname{bias}(b_{2})$. In terms of mean squared erorrs: $\operatorname{mse}(G_{2})<\operatorname{mse}(g_{2})<\operatorname{mse}(b_{2})$. So $G_{2}$ has the smallest mean squared error and the smallest bias of the three formulas. $b_{2}$ has the largest mean squared error and bias.
  6. For large samples ($n>200$) from non-normal distributions, the relation of the three formulas in terms of bias is: $\operatorname{bias}(G_{2})<\operatorname{bias}(g_{2})<\operatorname{bias}(b_{2})$. In terms of mean squared erorrs: $\operatorname{mse}(b_{2})<\operatorname{mse}(g_{2})<\operatorname{mse}(G_{2})$.

See also the Wikipedia page and the MathWorld page about kurtosis.

$\endgroup$
  • $\begingroup$ I'd call this a nice, clear interpretation of "the usual story". I'd add that the terms leptokurtic, mesokurtic, platykurtic are just baggage we should leave behind in the 20th century: we have a measure, which we should think about quantitatively. More seriously, the interpretation peaked versus flat-topped just does not justice to the great variation in possible shapes of distributions, even those that are all symmetric. Finally, bias in practice does not bite much unless you are playing with inappropriately small samples, but variance really does! $\endgroup$ – Nick Cox Jun 14 '13 at 11:48
  • $\begingroup$ Could you please clarify summary item #2? Evidently $G_2$ is a sample statistic but obviously it is not identically zero for any but a degenerate distribution. Perhaps you meant to say its expectation is zero? (BTW, what is "$\gamma_2$" in its formula? $g_2$ perhaps?) $\endgroup$ – whuber Jun 14 '13 at 12:30
  • $\begingroup$ @whuber: Yes, it's the expectation of $G_{2}$ that is zero, of course. The $\gamma_{2}$ was a relict from an earlier answer and should be $g_{2}$ (changed now); I've edited my answer quite heavily. $\endgroup$ – COOLSerdash Jun 14 '13 at 12:37
  • $\begingroup$ OK, looks better. I'll upvote it but hope you eventually remove that phrase "For a normal distribution $G_2=0$." $\endgroup$ – whuber Jun 14 '13 at 12:41
7
$\begingroup$

The link in question talks about SAS too. But in fact nothing in this question, except possibly the poster's own focus, limits it to those particular named programs.

I think we need to separate out quite different kinds of problem here, some of which are illusory and some of which are genuine.

  1. Some programs do, and some do not, subtract 3 so that the kurtosis measure reported is 3 for Gaussian/normal variables without subtraction and 0 with subtraction. I have seen people puzzled by that, often when the difference turns out to be say 2.999 and not exactly 3.

  2. Some programs use correction factors designed to ensure that kurtosis is estimated without bias. These correction factors approach 1 as sample size $n$ gets larger. As kurtosis is not well estimated in small samples any way, this should not be of much concern.

So, there is a small issue of formulas, #1 being a much bigger deal than #2, but both minor if understood. The advice clearly is to look at the documentation for the program you are using, and if there is no documentation explaining that kind of detail to abandon that program immediately. But a test case as simple as a variable (1, 2) yields kurtosis of 1 or 4 depending on #1 alone (with no correction factor).

The question then asks about interpretation, but this is a much more open and contentious matter.

Before we get to the main area of discussion, an often reported but little known difficulty is that kurtosis estimates are bounded as a function of sample size. I wrote a review in Cox, N.J. 2010. The limits of sample skewness and kurtosis. Stata Journal 10(3): 482-495. http://www.stata-journal.com/article.html?article=st0204

Abstract: Sample skewness and kurtosis are limited by functions of sample size. The limits, or approximations to them, have repeatedly been rediscovered over the last several decades, but nevertheless seem to remain only poorly known. The limits impart bias to estimation and, in extreme cases, imply that no sample could bear exact witness to its parent distribution. The main results are explained in a tutorial review, and it is shown how Stata and Mata may be used to confirm and explore their consequences.

Now to what is commonly regarded as the nub of the matter:

Many people translate kurtosis as peakedness, but others emphasise that it often serves as a measure of tail weight. In fact, the two interpretations could both be reasonable wording for some distributions. It is almost inevitable that there is no simple verbal interpretation of kurtosis: our language is not rich enough on comparisons of sums of fourth powers of deviations from the mean and sums of second powers of the same.

In a minor and often overlooked classic, Irving Kaplansky (1945a) drew attention to four examples of distributions with different values of kurtosis and behaviour not consistent with some discussions of kurtosis.

The distributions all are symmetric with mean 0 and variance 1 and have density functions, for variable $x$ and $c = \sqrt{\pi}$,

$(1)\ \ \ (1 / 3c) (9/4 + x^4) \exp(-x^2)$

$(2)\ \ \ (3 / (c \sqrt8)) \exp(-x^2 / 2) - (1 / 6c) (9/4 + x^4) \exp(-x^2)$

$(3)\ \ \ (1 / 6c) (\exp(-x^2 / 4) + 4 \exp(-x^2))$

$(4)\ \ \ (3 \sqrt3 / 16c) (2 + x^2) \exp(-3x^2 / 4)$

The kurtosis (without subtraction) is (1) 2.75 (2) 3.125 (3) 4.5 (4) 8/3 $\approx$ 2.667: compare the Gaussian or normal value of 3. The density at the mean is (1) 0.423 (2) 0.387 (3) 0.470 (4) 0.366: compare the Gaussian value of 0.399.

It's instructive to plot these densities. Stata users can download my kaplansky program from SSC. Using a logarithmic scale for density may help.

Without giving away the full details, these examples undermine any simple story that low or high kurtosis has a clear interpretation in terms of peakedness or indeed any other single contrast.

If the name Irving Kaplansky rings a bell, it is likely because you know his work in modern algebra. He (1917-2006) was a Canadian (later American) mathematician and taught and researched at Harvard, Chicago and Berkeley, with a wartime year in the Applied Mathematics Group of the National Defense Council at Columbia University. Kaplansky made major contributions to group theory, ring theory, the theory of operator algebras and field theory. He was an accomplished pianist and lyricist and an enthusiastic and lucid expositor of mathematics. Note also some other contributions to probability and statistics by Kaplansky (1943, 1945b) and Kaplansky and Riordan (1945).

Kaplansky, I. 1943. A characterization of the normal distribution. Annals of Mathematical Statistics 14: 197-198.

Kaplansky, I. 1945a. A common error concerning kurtosis. Journal, American Statistical Association 40: 259 only.

Kaplansky, I. 1945b. The asymptotic distribution of runs of consecutive elements. Annals of Mathematical Statistics 16: 200-203.

Kaplansky, I. and Riordan, J. 1945. Multiple matching and runs by the symbolic method. Annals of Mathematical Statistics 16: 272-277.

$\endgroup$
  • 1
    $\begingroup$ +1 Interesting comments about Kaplansky, with whose algebraic work I have long been familiar. $\endgroup$ – whuber Jun 14 '13 at 12:33
  • $\begingroup$ Nick, your comment "In fact, the two interpretations (peakedness and tailedness) could both be reasonable wording for some distributions." is incorrect an therefore not helpful, simply because kurtosis tells you nothing about "peakedness". Seriously, can you even define what "peakedness" means? And, a follow-up, if I may: Given your definition of "peakedness" (assuming you can come up with one), how does it relate, mathematically, to kurtosis? $\endgroup$ – Peter Westfall Nov 21 '17 at 1:44
  • $\begingroup$ @Peter Westfall If we can agree that kurtosis is what kurtosis measures, then my argument is just Kaplansky's argument, which is based on concrete curves and numerical results, not verbal sparring, i.e. that higher kurtosis sometimes goes with higher peak densities, and conversely for lower kurtosis. I am not at all partial to the term peakedness, and when obliged to simplify verbally tend to assert that in practice kurtosis is mostly a story of tail weight. I think the formulas here do all the work and carry all the statistical weight and find verbal polemics less helpful. $\endgroup$ – Nick Cox Nov 21 '17 at 2:07
  • $\begingroup$ In addition, there can't be, I suggest, any easy characterisation of kurtosis except for entirely symmetric distributions. I don't think anyone is obliged to define peakedness at all; the definition that exists is that of kurtosis and the practical questions are how to think about it and how far it is of use. $\endgroup$ – Nick Cox Nov 21 '17 at 2:09
  • $\begingroup$ The statement "simply because kurtosis tells you nothing about peakedness" is itself unsubstantiated. Missing references would certainly include your paper in TAS, which is accessible for interested people to consider your own lengthier discussion. $\endgroup$ – Nick Cox Nov 21 '17 at 2:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.