0
$\begingroup$

I have 10 participants who were asked to rate (from 1 to 5) 30 statements. I then asked each participant to assign each statement one of three categories.

I want to establish if there is an relationship between the rating scores and the categories, i.e. do the participants rate a specific category higher than others?

Which statistical test is appropriate for this?

My initial thoughts are ANOVA but I am not sure if this violates the independence assumption. The participants often disagreed on the categorisation of some of the statements.

Improve this question
$\endgroup$
2
  • $\begingroup$ This will depend to some extent on how you determine the participant rating of each category from the participant rating of the statement scores. It will also depend on how the categories were determined; did you give the participants three pre-defined categories and let them assign each statement to one, or did they get to make up their own categories? $\endgroup$
    – jbowman
    Commented Jul 13, 2022 at 3:36
  • $\begingroup$ I gave the participants pre-defined categories $\endgroup$
    – s21
    Commented Jul 15, 2022 at 8:32

1 Answer 1

Reset to default
2
$\begingroup$

Your rating variable is ordinal, so do not use anova. Also, since each participant has rated 30 statements, you should not assume independence. Maybe try ordinal regression with Participant as a random effect.

A similar problem is discussed at What regression model to use for judgment data?, also How to use ordinal logistic regression with random effects?

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.