# Appropriate Analysis for ordinal variable, repeated 4 times under different conditions, by the same 2 raters

I am doubting myself on which analysis to run for the following: 18 participants were evaluated at 4 time points with different conditions at each time. They were given scores (on a discrete visual analog scale) by 2 raters.

The scores were calculated for a pair of participants: the pairs changed at each time point. I do know which participant comprises each pair.

Is that a 2-way repeated measures ANOVA? Some variation of Friedman test?

• For clarity, did the same two raters see all 18 participants for all four time points? Did all 18 participants experience the same four-conditions? Finally, what is your research question: rater difference, condition difference, or time difference? – doug.numbers Apr 20 '13 at 21:16
• Yes. Both raters reviewed all 18 participants at the 4 points. I am interested in condition difference (perhaps controlling for practice effect over time), but using the raters to confirm scoring. THANKS!!! – Patrick Apr 22 '13 at 0:24
• Try to understanding your data before you do an ANOVA. First, plot your data to ensure that it is normally distributed. Then plot total score by rater to determine if there is a difference between raters. Estimate mean and 95% CI for the mean for each rater. Then estimate mean and 95% CI for the mean for the average total score of the raters for each of the four conditions. Check and see conditions don't have overlapping of the confidence intervals. Try doing boxplots with notches to visualize overlap. ANOVA will tell you if one of the conditions is different, but not which. – doug.numbers Apr 22 '13 at 12:55