What are the reason/s to use a nonparametric normality test (e.gr., Shapiro-Wilk, Jarque-Bera) instead of generic, parametric goodness-of-fit tests (good for any distribution including but not limited to the normal, with parameters, like $\chi^2$ or Kolmogorov-Smirnov) for some data we want to check for normality?
$\begingroup$
$\endgroup$
10
-
1$\begingroup$ What distinction are you making by calling something a "goodness-of-fit test to a normal distribution" instead of a "normality test"? What are some examples of such tests you might have in mind? $\endgroup$– whuber ♦Commented May 24, 2022 at 19:55
-
1$\begingroup$ Those are all Normality tests. $\endgroup$– whuber ♦Commented May 24, 2022 at 20:04
-
1$\begingroup$ I honestly can't figure out what you mean by "goodness of fit test." All the ones you have named so far are manifestly tests of normality. $\endgroup$– whuber ♦Commented May 24, 2022 at 20:15
-
1$\begingroup$ @whuber I believe you, but I'm puzzled. en.wikipedia.org/w/index.php?title=Goodness_of_fit_test. Some of these tests work for any distribution and require that the parameters are included as part of the null hypothesis, some only work for the normal distribution and don't require parameters (maybe I'm wrong about this?) $\endgroup$– RafaelCommented May 24, 2022 at 20:32
-
4$\begingroup$ I don't think you're wrong. The distinction you seem to be making is between tests of specific distributions and tests of distribution families, and that's well worth making. But that distinction is neither apparent in your question nor is it appropriate for the examples you give, since what is usually meant by "checking data for normality" and "goodness of fit ... to a normal distribution" are all ordinarily understood to be testing whether data come from a normal family. $\endgroup$– whuber ♦Commented May 24, 2022 at 21:13
|
Show 5 more comments
2 Answers
$\begingroup$
$\endgroup$
11
First, it's worth noting that testing for normality is a basically useless activity (cf., Is normality testing 'essentially useless'?). No dataset in the real world is normally distributed, so we already know the null hypothesis behind these tests is false. What's left is that the test can correctly reject the null, if the sample size is large enough relative to the way the data deviate from true normality, or can yield a type II error, if the dataset is relatively smaller. However, what really matters isn't how many data you have, but the size and nature of the deviation from normality, which tests can't tell you.
That having been said, the reason specialized tests like the Shapiro-Wilk are used instead of generic goodness of fit tests, is because we primarily care about some specific types of deviations from normality. Data can deviate from normality in potentially innumerable ways. For simplicity, you can imagine a distribution that has the same kurtosis (fat-tailed-ness) as a normal, but differs in being skewed, or a distribution that differs in kurtosis, but is perfectly symmetrical. If you tested one of those parameters, you would miss the other. Of course, a general test will in some sense cover everything, but not with equal power—it will be more sensitive to some deviations than others. Which deviation will be most detectable will differ by test. Thus, you might as well use the test that is maximally sensitive to the deviations you care about. Those are deviations in the tails, and the Shapiro-Wilk is weighted to preferentially detect them.
answered May 24, 2022 at 19:55
-
1$\begingroup$ +1 for the latter stuff, but I am always astonished that so many people want to make general statements about "uselessness" (or usefulness) of preprocessing approaches such as normality testing without making the proviso that it ultimately depends on the purpose. As long as for any given data set size I cannot predict whether normality will be rejected or not, such a test is informative, and then one has to discuss whether the information it gives is useful, which depends on what exactly you'd want to do with the result. $\endgroup$ Commented May 24, 2022 at 20:44
-
2$\begingroup$ I should add that I agree that no real data are really normal, but the question whether the data "look like generated from a normal" (even though we know it isn't) can still be of interest. All our models are thought constructs and tools, and not meant to be "true", but in certain situations we may want to drop them if the data clearly contradict them. $\endgroup$ Commented May 24, 2022 at 20:45
-
1$\begingroup$ The way people who attempt to apply statistics to some application area most often tend to use normality tests (as a way to decide what test - indeed what specific hypothesis - to use on some data, by testing that same data), they're not just mostly useless, but pretty actively problematic. From what I have seen, this appears to account for an overwhelming majority of times that normality tests are used. $\endgroup$– Glen_bCommented May 24, 2022 at 22:45
-
1$\begingroup$ @Glen_b While I agree on it being "problematic", I'm not as generally negative as some others about it, see here: arxiv.org/abs/1908.02218 $\endgroup$ Commented May 24, 2022 at 23:22
-
2$\begingroup$ @gung-ReinstateMonica (a) I agree that null hypothesis testing is often misused and misinterpreted. (b) In my view no model can be "true" or should ever be "believed" (that's just the wrong category for models) and null hypothesis tests are not about "believing" one model or the other, they are about compatibility of data with model. As there is no way to get any better relation between model and data than compatibility, tests have their sense. (I'm not saying compatibility as measured by tests is always the right thing to ask for. But I find a general negative statement is not appropriate.) $\endgroup$ Commented May 25, 2022 at 11:21
$\begingroup$
$\endgroup$
There is some literature comparing the power of different normality tests, often involving both specific tests for normality and more general goodness-of-fit approaches that can be applied to general distributional shapes (so as pointed out already, only calling the former "normality tests" is a misnomer and many would also include specific normality tests in the more general class of "goodness-of-fit tests").
The power generally depends on against what kind of distributions normality is tested, however pretty much all that I have seen favours Shapiro-Wilks over Kolmogorov-Smirnov and Chi-Squared.
See for example
Thode HJ. Testing for normality. New York: Marcel Dekker; 2002.
B. W. Yap & C. H. Sim (2011) Comparisons of various types of normality tests, Journal of Statistical Computation and Simulation, 81:12, 2141-2155, DOI: 10.1080/00949655.2010.520163
Googling "compare normality test" or looking into the references of those cited above will bring up more.
answered May 24, 2022 at 20:57