Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.
up vote 1 down vote favorite

I'm analysing a study of 4 raters and 34 subjects. I'm looking at the inter rater reliability. For the ordinal results, I did a weighted kappa of Fleiss and for the other continuous results I calculated an ICC (2,1).

My question is if the data has to follow a normal distribution to be able to use the Kappa of Fleiss and the ICC (2, 1) correctly?

share|improve this question
Kappa is a measure of inter-rater reliability. How could such data be normally distributed? They are discrete, usually with a quite small number of categories. – Peter Flom Sep 27 '12 at 11:12

1 Answer

up vote 3 down vote

The Kappa statistics have to do with level of agreement in contingency tables and there is no normal distribution involved. The same is true for intra class correlation.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.