I am trying to apply the Dietterich 5x2 cv t-test to test whether one statistical model is better than another on a particular data set.
In order to apply this test, one must assume that under the null hypothesis, the Dietterich statistic follows a t-distribution.
Is there any way to validate this assumption? Is it possible to somehow sample from the null distribution in order to see whether it follows a t-distribution? Can this be done with a permutation test?