# Inter-rater reliability for multiple categorial variables and two raters

We want to know the Inter-rater reliability for multiple variables. We are two raters. The variables are all categorial. This is just an example:

variablename    possible values
sex             m, f
jobtype         parttime, fulltime, other
city            0,1,2,3,4,..,43 (there is a codenumber for each city)


The two raters extracted the data from "difficult" sources. There is a possiblity of errors and misstakes in that process.

First we thought about "Cohans Kappa". But we are not sure how to use this with multiple variables and if it is the right solution for our needs. Maybe there is another statistical methode better fitting to our needs?

The point is we don't want to give Kappa for each variable. We want one Kappa (or something else) for the complete process (two raters, multiple variables).

• Perhaps read Cronbach's alpha for inspiration. – Carl Oct 17 '16 at 19:46