I have read about Student's t-test but it appears to work when we can assume that the original distributions are normally distributed. In my case, they are definitely not.
Also, if I have 13 distributions, do i need to do
There are several senses in which "it depends".
(One potential concern is that it looks like the original data might perhaps be discrete; that should be clarified.)
Firstly, you don't need to test $A$ vs $B$ and $B$ vs $A$ (the second comparison is redundant).
Secondly, you don't need to test $A$ vs $A$.
Those two things cut the pairwise comparisons down from 169 to 78.
Thirdly, it would be much more usual (but not compulsory) to test collectively for any differences, and then, perhaps to look at pairwise differences in post-hoc pairwise tests if the first null was rejected.
For example, in place of a Wilcoxon-Mann-Whitney as in item 3. above, one might do a Kruskal-Wallis test, which is sensitive to any differences in location between groups.
There are also k-sample versions of the Kolmogorov-Smirnov test, and similar tests of some of the other two-sample goodness of fit tests might exist, or be constructed.
There are also k-sample versions of resampling tests, and of the t-test (i.e. ANOVA, which might be okay if the sample sizes are reasonably large).
It would be really nice to get more information about what we're dealing with and what kinds of differences you're most interested in; or failing that, to see Q-Q plots of some of the samples.
|show 1 more comment|
Yes, I think you cannot do better than testing each distribution against the others...
If think that your question is related to this one :Comparison of 2 distributions
You advise you to use a Kolmogorov-Sminorv test or a Cramér-Von Mises test. They are both very classical adequation tests.
To learn about these two tests : http://en.wikipedia.org/wiki/Kolmogorov%E2%80%93Smirnov_test http://en.wikipedia.org/wiki/Cram%C3%A9r%E2%80%93von_Mises_criterion
You can try Kruskal–Wallis one-way analysis of variance
"It is used for comparing more than two samples that are independent, or not related"
Normality violations in ANOVA were discussed in
The first line there is "Although most sources report ANOVA ... as being robust with respect to violations of the normality assumption..."