I'm currently looking for a test having for null hypothesis that the sample does not come from observing a normally distributed random variable. In other words, I'd like to know if there's a test that's opposite to the K-S, Anderson-Darling, Shapiro-Wilk or Jarque-Bera.
I think the question is the same whether normality is the null hypothesis or the alternative. the test is a measure of goodness of fit. If the test is based on the traditional approach then you look for how large the test statistic should be to reject normality. If the you make normality the alternative then you are asking how small this statistic needs to be to say the distribution is close enough to normal.
I have not seen this done but it is very much akin to equivalence testing which is done a lot in the pharmaceutical industry. For equivalence testing you want to show that your drug perform similarly to the competitor drug. This is often done when trying to find a generic replacement for a marketed drug. You define a small distance from 0 that you call the window of equivalence and you reject the null hypothesis when you have high confidence that the true mean difference in the performance measure is within the window of equivalence. The method is well defined in Bill Blackwelder's paper "Proving the Null Hypothesis." The test statistics are the same or similar it is just executed differently. For example instead of using a two-tailed t test to show that the mean difference is different from 0, you do two one-sided t tests where you need to reject both to claim equivalence. The sample size is determined such that the power of rejecting nonequivalence when the actual mean differnce is less than some specified small value.
I think that a test to reject nonnormality could be posed in the same way.
|show 1 more comment|
I think the problem is not well defined! You want to proove the data "do not come from a normal distribution". That is easy, accept! NO data "comes from a normal distribution", the normal distribution is at best an approximation.
But you could, of course, have goodness-of-fit tests for other distributions, say the Poisson. I don't know if there is a lot published, but what you can do, is to make a qq-plot for the choosen distribution. For the Poisson case, what you can doo is (R code):
and a test statistic could be the correlation in the qqplot: cor(p,sort(dat))
Now you can find the null distribution of this statistic by simulation:
In practice, you will presumably estimate the poisson mean, so you must redo the simulation incorporating estimation of the mean. You will also probably want to increase the number of simulated samples from 1000!
The simulation incorporating estimation of the mean could be:
The answer is Chi square Goodness of fit test for normal distribution
Here you can see the example http://www.stat.yale.edu/Courses/1997-98/101/chigf.htm