I need to ask about how many categories can be included in a weighted kappa or cohens kappa statistic for inter observer reliability.
Effectively we need to be reliable in assessing whether the distance between two monkeys is: 0m, 1m, 3m, 5m or >5m.
Normally for a cohens kappa it is a binomial agree/disagree although I have seen a cohens kappa done with three categories. I obviously have 5 categories and I wondered if it was possible to calculate a weighted cohens kappa result for my data which has the 5 categories above?
If so how could this be calculted either in excel or R?