I use four feature descriptors for five independent runs with each run randomly selecting the training set and testing set from the total labeled samples. SVM is the classifier. After acquiring the classification accuracy of each run for each descriptor, I get a accuracy matrix whose size is $5 \times 4$. Then I use the
ranksum function in
MATLAB to do Wilcoxon run sum test from pair-wise. Then I get the
p-value matrix shown as follows:
I select $\alpha = 0.05$. If the
p-value is less than $0.05$, then the difference is significant, and if the
p-value is larger than $0.05$, then the difference between the two features is not significant. Is it right? Is the total procedure of statistical tests right? Thank you.