To assess goodness of fit, chi-squired test and Kolmogorov-Smirnov test, etc. are traditionally recommended. However considering necessity of equivalence tests, these tests seems not to be suitable for test of goodness of fit. Because null hypotheses of these tests are that the data are fitted by some function, according to regular course of hypothesis testing, If the null hypotheses are not rejected, this does NOT mean that accept the null hypotheses, i.e., we can not conclude the data are suitably fitted by some function.
Of cause, these traditional tests have certain significance for quantitative evaluation of goodness of fit. However if one wants to evaluate goodness of fit by hypothesis-testing sense, I think one has to carry out some tests using equivalence tests sense for this. In such case, a null hypothesis is that the data are NOT fitted by some function, more specifically for example, amount of RMS of residuals between the data and fitted function is more than some quantity which indicates criterion of closeness. Is there such a way?
I think that normality tests such as Shapiro-Wilk test have same problem.

Below questions are similar.
Is there any test for a null hypothesis of non-normality?
How to verify if values are from Gamma distribution?
Distribution hypothesis testing - what is the point of doing it if you can't "accept" your null hypothesis?
how do normality check in ks test assess for equivalence or difference in data sets?



Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.