1
$\begingroup$

I'm looking for a non-parametric (!) alternative to the Friedman test. I have > 2 subjects and measured one quantity per subject. I want to know whether there is a significant difference between any of these subjects. Please note that I used the Friedman test before because there were repeated measured per subject.

Is the Kruskal-Wallis test suitable here? Can you recommend any post-hoc test to identify which of the subjects are significantly different?

Thanks!

Improve this question
$\endgroup$
4
  • 1
    $\begingroup$ If I understand correctly, you now have independent observations and KW ANOVA followed by any suitable nonparametric technique for pairwise comparisons should be ok. However, what is your classification factor? $\endgroup$
    – chl
    Commented May 14, 2014 at 10:26
  • $\begingroup$ @chl: Thanks. What do you mean by "classification factor"? Here's an example: I have 3 different algorithms which are evaluated on the same data, resulting in three performance measures. Now I want to know: 1) Whether there is any significant difference in the three algorithms at all; 2) Whether there is a significant(post-hoc) pairwise difference. Which test/post-hoc test fits this scenario? $\endgroup$
    – Chris
    Commented May 14, 2014 at 12:51
  • 1
    $\begingroup$ In this case, I would say that your classification (grouping, independent) factor is the type of algorithms. $\endgroup$
    – chl
    Commented May 14, 2014 at 13:29
  • $\begingroup$ Right. Does anyone have a suggestion for a post-hoc test? Is Tukey HSD suitable here? $\endgroup$
    – Chris
    Commented May 14, 2014 at 14:25

1 Answer 1

Reset to default
1
$\begingroup$

Dunn's test is the appropriate post hoc test for after rejecting a Kruskal-Wallis test. See more here: Post-hoc tests after Kruskal-Wallis: Dunn's test or Bonferroni corrected Mann-Whitney tests?.

You might perform using the npmc package for R, or the dunntest package for Stata.

Dunn, O. J. (1964). Multiple comparisons using rank sums. Technometrics, 6(3):241–252.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.