14
$\begingroup$

Applied linear statistical models by Kutner et al. states the following concerning departures from the normality assumption of ANOVA models: Kurtosis of the error distribution (either more or less peaked than a normal distribution) is more important than skewness of the distribution in terms of the effects on inferences.

I'm a bit puzzled by this statement and did not manage to find any related information, either in the book or online. I'm confused because I also learned that QQ-plots with heavy tails are an indication that the normality assumption is "good enough" for linear regression models, whereas skewed QQ-plots are more of a concern (i.e. a transformation might be appropriate).

Am I correct that the same reasoning goes for ANOVA and that their choice of words (more important in terms of the effects on inferences) was just chosen poorly? I.e. a skewed distribution has more severe consequences and should be avoided, whereas a small amount of kurtosis can be acceptable.

EDIT: As adressed by rolando2, it's hard to state that one is more important than the other in all cases, but I'm merely looking for some general insight. My main issue is that I was taught that in simple linear regression, QQ-plots with heavier tails (=kurtosis?) are OK, since the F-test is quite robust against this. On the other hand, skewed QQ-plots (parabola-shaped) are usually a bigger concern. This seems to go directly against the guidelines my textbook provides for ANOVA, even though ANOVA models can be converted to regression models and should have the same assumptions.

I'm convinced I'm overlooking something or I have a false assumption, but I cannot figure out what it might be.

Improve this question
$\endgroup$
6
  • 4
    $\begingroup$ In his review of kurtosis, DeCarlo (1997) suggested the exact opposite, that skew was more important in ANOVA and other tests of equality of means. You might find the citations on page 297 to be useful: columbia.edu/~ld208/psymeth97.pdf $\endgroup$
    – Anthony
    Jan 4, 2015 at 15:51
  • 1
    $\begingroup$ I'd find the question most productive if it could be resolved into a statement such as "Skewness is so much more important to inferences than kurtosis that skewness at the level of ___ would typically distort results as much as would kurtosis at the level of ___." Without some such quantification, merely to say one or the other is more important doesn't help us much. $\endgroup$
    – rolando2
    Jan 4, 2015 at 17:14
  • $\begingroup$ This simulation emis.de/journals/HOA/ADS/Volume7_4/206.pdf by Khan and Rayner (2003) in JOURNAL OF APPLIED MATHEMATICS AND DECISION SCIENCES states that "Both the ANOVA and Kruskal-Wallis tests are vastly more affected by the kurtosis of the error distribution rather than by its skewness" (p. 204). $\endgroup$
    – bsbk
    Jan 4, 2015 at 18:46
  • $\begingroup$ An extremely closely related question concerning the two-sample t-test - effectively a one-way ANOVA with two levels in the factor - is stats.stackexchange.com/questions/38967/… ... There is currently a bounty there for added references as none of the existing answers contain citations, so answerers to this question might want to take a look at it. $\endgroup$
    – Silverfish
    Jan 5, 2015 at 11:53
  • $\begingroup$ I agree with @rolando2: "skewness is worse than kurtosis" or vice versa is a rather vacuous statement without mentioning the degree of skewness/kurtosis. But also more needs to be considered! For instance, robustness to these kinds of violations of normality partly depends on whether the group sizes are equal, and robustness to skewness can depend on the direction of skewness - it's worse if one group is one skewed one way, and the other group skewed the contrary way, than if both groups were skewed in the same direction. (This is from memory and re t-tests but that is a type of ANOVA.) $\endgroup$
    – Silverfish
    Jan 5, 2015 at 13:56

2 Answers 2

Reset to default
7
$\begingroup$

The difficulty is that skewness and kurtosis are dependent; their effects can't be completely separated.

The problem is that if you want to examine the effect of a highly skew distribution, you must also have a distribution with high kurtosis.

In particular, kurtosis* $\geq$ skewness$^2+1$.

* (ordinary scaled fourth moment kurtosis, not excess kurtosis)

Khan and Rayner (which is mentioned in the earlier answer) work with a family that allows some exploration of the impact of skewness and kurtosis, but they cannot avoid this issue, so their attempt to separate them severely limits the extent to which the effect of skewness can be explored.

If one holds the kurtosis ($\beta_2$) constant, one cannot make the skewness more than $\sqrt{\beta_2-1}$. If one wishes to consider unimodal distributions, the skewness is even more restricted.

For example, if you want to see the effect of high skewness - say skewness > 5, you cannot get a distribution with kurtosis less than 26!

So if you want to investigate the impact of high skewness, you are unable to avoid investigating the impact of high kurtosis. Consequently if you do try to separate them, you in effect hold yourself unable to assess the effect of increasing skewness to high levels.

That said, at least for the distribution family they considered, and within the limits that the relationship between them poses, the investigation by Khan and Rayner does seem to suggest that kurtosis is the main problem.

However, even if the conclusion is completely general, if you happen to have a distribution with (say) skewness 5, it's likely to be little comfort to say "but it's not the skewness that's the problem!" -- once your skewness is $>\sqrt{2}$, you can't get a kurtosis to be that of the normal, and beyond that, minimum possible kurtosis grows rapidly with increasing skewness.

Improve this answer
$\endgroup$
11
$\begingroup$

This issue is addressed in "Robustness to Non-Normality of Common Tests for the Many-Sample Location Problem" by Khan and Rayner.

They found ANOVA tests are vastly more affected by the kurtosis than skewness, and the effect of skewness is unrelated to its direction.

If deviations from normality are suspected, Kruskal-Wallis test might be a better choice. Kruskal-Wallis test is more robust to deviations from normality because it examines the hypothesis that treatment medians are identical. ANOVA examines the hypothesis that treatment means are identical.

Improve this answer
$\endgroup$
1
  • $\begingroup$ Does this then also indicate I should interpret QQ-plots differently for linear regression and ANOVA? The majority of transformations I've done reduced skewness, but left slightly heavy tails (=kurtosis?). I was under the impression that the F-test was robust enough to deal with the latter but not the former. Or is this "heavy tails are OK" a misunderstanding on my part? I cannot imagine that there exists such a fundamental difference between the two, since ANOVA models can also be re-written as linear regression models. $\endgroup$
    – Zenit
    Jan 5, 2015 at 9:33

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.