Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

For my problem I have a group of p participants and s subjects. I was suggested to calculate the Kappa Cohen Test on combinations of two for p and s, then calculate the mean and compare against the uniquely calculated value of Fleiss` kappa for the same set.

My question is, whetheror not it is correct/safe to calculate a mean over the Cohen's kappa test?

More specifically, I am using the Kappa2 and Fleiss' kappa with the flag set to FALSE from the irr R package. Setting the flag to false means that a variant algorithm of Kappa Fleiss is used so that it can be reduced to Kappa Cohen when the population has p=2 s=2.

share|improve this question

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.