Questions tagged [friedman-test]

A non-parametric test for the equality of >2 dependent groups.

Filter by
Sorted by
Tagged with
0 votes
0 answers
17 views

Kruskal-Wallis versus Friedman - Paired data, but not repeated measures/blocks?

I'm trying to compare the difference in behaviour of an animal with no enrichment to the same animal with two (or more) types of enrichment. (Total active behaviours before/total active behaviours ...
user avatar
  • 1
1 vote
0 answers
50 views

Friedman Test not working. Is this the appropriate statistical test?

I am trying to determine if the mean distance between animal pairs changes across months. According to a Shapiro Wilk test, my mean distance measurements are not normally distributed. Due to this, I ...
user avatar
  • 33
0 votes
0 answers
25 views

Compare mean of subsamples between groups

I am going to collect quantitative data for two groups that I would like to compare. I have done a two sample t-test on some preliminary data and found a significant difference, but I don't think that ...
user avatar
  • 1
0 votes
0 answers
28 views

Statistically comparing supervised text classifiers

I currently have 4 supervised text classifiers, namely: Naive Bayes, Semi Naive Bayes, Bernoulli Naive Bayes, and SVM. As a performance metric, I am currently using the F1 score. I also wish to deduce ...
user avatar
  • 1
0 votes
0 answers
99 views

Effect size measure for post-hoc tests after nonparametric tests: Alternatives to calculating r from z score?

I've calculated Friedman's tests for my data and want to report an effect size with the individual post-hoc tests that followed on from the statistically significant Friedman's test. I use the formula ...
user avatar
  • 625
0 votes
1 answer
18 views

Which ANOVA / non-parametric alternative should I use?

Apologies if this is a really simple question but I cannot work it out. I am trying to find out if year and/or location influence the amount of insects caught. Insects are measured in grams per 10km2. ...
user avatar
  • 1
0 votes
0 answers
75 views

For Friedman Test, what are the pros and cons of different post hoc comparison method?

scikit_posthocs lists some post hoc pairwise comparison methods if significant results of the Friedman’s test are obtained. How do I decide which one to use? In my case, the toy dataset ...
user avatar
2 votes
1 answer
92 views

Which statistical method can be used to compare the values of the same variables measured from different views?

I got a biological data set, where I need to run a statistical analysis on. The data was created on a mass spectrometer and contains the intensity values for around one hundred lipids. The analysis ...
user avatar
0 votes
0 answers
24 views

How to do a post-hoc comparison after friedman.test?

An example is as follows: ...
user avatar
2 votes
1 answer
31 views

Compute Exact Null Distribution for Friedman Statistic

Problem Statement: If there are no ties and $b=2,\;k=3,$ derive the exact null distribution of $F_r,$ the Friedman statistic. Note: This is Exercise 15.35 in Mathematical Statistics with Applications, ...
user avatar
0 votes
1 answer
30 views

What test to perform on my complicated data...?

I have data that looks like this: I'm trying to analyze time and num_collisions. Subjects completed each combination of device/rho/lam/hmd x 6 trials [within subjects design, repeated trials] There ...
user avatar
0 votes
1 answer
27 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
user avatar
  • 119
1 vote
0 answers
47 views

An a posteriori test to determine non difference across >3 groups given a skewed continuous variable of interest, as an alternative to a Friedman-test

Given a set of items of which each item is once measured using a computative model, each time under a different condition, what is the best way to quantify the magnitude of difference between ...
user avatar
0 votes
0 answers
43 views

How can we prove that kruskal wallis test and jonckheere test is equivalent to wilcoxon rank sum test?

How can we prove that kruskal-Wallis test and Jonckheere test is equivalent to Wilcoxon rank sum test when k = 2? And how can we prove that Friedman test and Page test is equivalent to sign test when ...
user avatar
  • 1
0 votes
0 answers
46 views

Friedman's test over multiple dependent datasets

In 'Statistical comparisons of classifiers over multiple data sets', Friedman's test is applied to compare different machine learning algorithm performances over different datasets (obtained from ...
user avatar
1 vote
1 answer
124 views

Friedman's test is very significant, but its post hoc comparisons are not significant

This post does not include an answer for my question. I have perform a Friedman test on a results obtained by several methods on multiple datasets, as described in this paper: "Statistical ...
user avatar
0 votes
1 answer
131 views

Should I rank my data before doing post hoc Dunn test?

I am trying to compare multiple algorithms using the Friedman test and post hoc Dunn test. I know that we should use the rank of our data before performing the Friedman test, but should we rank the ...
user avatar
  • 1
1 vote
0 answers
140 views

Should I use Friedman test or Mixed Model for my data in R? Nested or not?

I have my Response variable which is Proportion of Range Exposed to extreme events for terrestrial mammal species in the future. More clearly, it is the Difference of Proportion of Range Exposed (DPRE)...
user avatar
1 vote
0 answers
26 views

Every time I run a statistical test, my n-value is doubled

I just finished collecting data for a small study with a within-subject design looking at caching behaviour and how it can be affected by a bird's surroundings. My study had three experimental ...
user avatar
  • 11
0 votes
0 answers
124 views

Statistical significance test for 5-fold cross validation on a single dataset

I have used stratified 5-fold cross validation to generate five data folds to compare several (N) deep learning models on a single dataset. Now, I have the fold-wise test accuracies for all of the ...
user avatar
0 votes
0 answers
42 views

Kruskal-Wallis test for ranking data

I have a complex experimental design where there are 3 groups, and in each group, a ranking/comparison is made between items (list of items). Each ranking is associated with 9 measurements on a 5 ...
user avatar
1 vote
0 answers
230 views

Error in friedman.test.default(c(3.7005, 1.3212, 2.0572, 1.8833, 0.4539, : not an unreplicated complete block design [closed]

I have a non-parametric data and would like to run Friedman Test. Here is my code: res <- data_copy %>% friedman_test( ten ~ res | order) res However, I got ...
user avatar
  • 11
1 vote
0 answers
23 views

Computing statistical Significance of Rank Order Question

In my questionnaire, I have a rank order question concerning three different videos. Each respondent must rank each of the videos either on position 1, 2 or 3. All respondents are in the same group (...
user avatar
0 votes
1 answer
38 views

What Statistical test should I use

I am conducting an empirical study, I applied 3 treatments on the sample of 23 objects. The treatments 1 and 2 are independent but the treatment 3 is the combination of the first two. I want to test ...
user avatar
0 votes
0 answers
106 views

Is there a non-parametric test to replace repeated-measures ANOVA in R?

I have a data set with 41 individuals, male and female, and 3 different measurements of a variable for each individual. The data is not normally distributed, nor does it have equal variances between ...
user avatar
0 votes
0 answers
68 views

Accounting for non-independence of measurements in analysis of variance

I have 10 measurements for each of 50 patients, each obtained at 3 different time points (i.e. 500 + 500 + 500 values). The measurements are of the same quantity but were measured in different ...
user avatar
  • 21
1 vote
0 answers
52 views

Relevant statistical test for data of a ranking experiment

I'm currently thinking of a relevant statistical test to use to assess the results of a small study. Imagine i have 6 different brand of a food product and i want to know whether the participants to ...
user avatar
  • 111
1 vote
0 answers
35 views

Efficient way to compare algorithms performance with missing samples

I'm currently doing some experiments to compare more than 70 different configurations (different parameters of an evolutionary algorithms) that have 30 runs each (repeated due to stochastic results). ...
user avatar
0 votes
1 answer
207 views

What does it mean if Nemenyi test does not return that the performance of two methods are significantly different while the Wilcoxon test does?

I want to compare the performance of $N$ methods on $m$ datasets. I performed the Friedman test and after that the Nemenyi test. The Nemenyi test is though not powerful enough to conclude that there ...
user avatar
  • 101
0 votes
2 answers
417 views

Friedman's test in SPSS gives different results from R and python

I have a repeated measurement of n=452 participants. The Friedman test of SPSS gives df=2, chi-square 36.970 whereas below is the output of R and python. I cannot explain this difference for chi-...
user avatar
  • 41
1 vote
2 answers
444 views

Kendall’s Coefficient of Concordance (W) is different when calculate with two formula: SPSS VS python

I used the Friedman test to compare three repeated measures and I use Kendall’s Coefficient of Concordance (W) to get its effect size. SPSS uses this formula: F (from Friedman test)/n_f (k-1), and I ...
user avatar
  • 41
1 vote
1 answer
943 views

How to do Friedman test and post--hoc test on Python? [closed]

I know that Python's SciPy library has the function for the Friedman test But, it is not enough as I need more information for posthoc test. So, how I do Friedman test and post-hoc test entirely on ...
user avatar
  • 9
1 vote
1 answer
22 views

Can I use `wilcox_test()` to compar multiple means without `friedman_test()`?

In this example,use friedman_test() first to find significant difference between group,and then use ...
user avatar
  • 284
1 vote
0 answers
67 views

Friedman test when the observations are different from each other

I have database which has data about 72 plants, that got 6 different treatments. I have measured the weight of those plants every day and every hour for the past two weeks.so basically there is ...
user avatar
  • 61
2 votes
1 answer
49 views

Statistical test for ordinal variable distribution between groups

I have a dataset with sentiment of tweets labelled as 1, 2 or 3 (1=Negative, 2=Neutral, 3=Positive) ... 10,000 observations approx. I have this split by geographic location (Africa, Americas, Asia, ...
user avatar
  • 23
0 votes
0 answers
25 views

Most suitable stat test for this data?

Looking for a difference between: count and size, exposure, animal and colour (CountXsizeXexposureXanimalXcolour). There are 480 data in each column of which: 240 each - size (0.5mm and 2mm) 240 ...
user avatar
2 votes
2 answers
275 views

Repeated measurements with different measurement methods and uneven sample size - which test is suited?

I am struggling to find the appropriate statistical test to analyze my data. I hope that my question will be understandable. I have the following setup: A porcine spine with three vertebral bodies (...
user avatar
3 votes
1 answer
656 views

Post-hoc Friedman Nemenyi Test

I used Friedman and Post-hoc Friedman Nemenyi Test. In this PAPER, page 11, the Critical Difference (CD) equation is different from what has been used in R function, PAGE 14 ...
user avatar
  • 1,497
0 votes
0 answers
22 views

Friedman's Test fails inspite of big differences between the average ranks of algorithms

I performed Friedman's test to validate that a particular algorithm is statistically different from other compared algorithms. For example: I wanted to prove my ...
user avatar
1 vote
1 answer
120 views

Question on the Friedman test and statistical significance

I have 322 clothing items that have been ordered by our military from 2013 to 2018. Each military member is either in a Tier 1 or Tier 2 location. I ran Friedman tests on each individual item over ...
user avatar
  • 239
0 votes
1 answer
123 views

Choice of non-parametric test in repeated measures

I have a question concerning the statistical analyses to conduct in the context of a psychology experiment. There are two groups of students (experimental and control) who are exposed to either the ...
user avatar
1 vote
1 answer
244 views

Friedman test for rank order question - Comparing between groups

In my study, participants ranked a total of 5 designs (different lamp types) in their order of preference (absolute favourite, second favourite, etc.). Participants ranked all lamps, and lamps were ...
user avatar
  • 53
4 votes
1 answer
249 views

What is the right Bonferroni adjustment?

I am trying to test a hypothesis for my Masters Thesis. There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each ...
user avatar
  • 41
0 votes
1 answer
61 views

Statistical Analysis of 3 groups(parameterisation of same algorithm) under the same dataset: non-repeated measures or repeated-measures?

I'm analyzing the performance of 3 parameterizations of the same algorithm under the same dataset. This performance is user-evaluated under a single Likert-type item (5-values). Given the ordinal ...
user avatar
  • 155
0 votes
1 answer
316 views

How to arrange my data for Friedman's test

I have conducted a study where participants have seen photos of people in different categories, let's call them A, B C, and D, and have ranked four pictures in each category on 1st choice to 4th ...
user avatar
  • 33
0 votes
1 answer
54 views

Independent or matched groups?

A very beginner level question here: I'm trying to see whether there is a difference in how students assess the usefulness of 5 possible courses to be added to their curriculum. Each student was asked ...
user avatar
  • 103
0 votes
1 answer
133 views

Is the ICC appropriate here?

I have N tissue samples, labelled as either A or B. 2 measurements are taken from each sample. The data is not normally distributed. I'm interested in 2 things: firstly, whether there is ...
user avatar
  • 33
1 vote
0 answers
25 views

Analysis for a Within-Subjects Design with Ordinal IV and Continuous DV

I have a set of non-normal data I'm trying to analyse but am worried I'm violating the assumptions of my chosen test. I have a 18-trial within subjects experimental design. Participants received an ...
user avatar
0 votes
0 answers
140 views

How do I set up the data for a Friedman Test?

Below is a small sample of a very large data set (over 10,000 records). All I'm trying to do is determine if there's a statistically significant difference found in the ordering of supplies among ...
user avatar
  • 239
0 votes
1 answer
52 views

Which statistical test for my data?

(EDIT: question simplified) This is a basic question, since I am new to data analysis and statistics. I am carrying out a 2X3 factorial survey where participants are presented with a series of ...
user avatar
  • 23