Suppose I have two samples S1 and S2, but they are dependent samples. My aim is to compare if the mean of S1 is significantly smaller than the mean of S2. The samples are not normally distributed, so because of the distributional assumption, a non-parametric test (Wilcoxon sum-rank test, say) is preferred. However, these kind of non-parametric tests still require the samples to be independent.
My question is, is there a test that deals with dependent samples? How about sampled permutation test? For example, I have 5 data points in S1 and 10 data points in S2, and I can do the following (set
counter = 0):
- Reshuffle the 15 points into 2 groups, each having 5 and 10 points
- Calculate the means of group 1 and group 2, and denote the difference as m1
- Compare with the observed mean difference m0: if m0 < m1,
Repeat the steps above for N=1000 times, and the p-value is
Will this sampled permutation test handle dependent data well, compared with a single non-parametric test? Thanks!