We want to know the Inter-rater reliability for multiple variables. We are two raters. The variables are all categorial. This is just an example:
variablename possible values sex m, f jobtype parttime, fulltime, other city 0,1,2,3,4,..,43 (there is a codenumber for each city)
The two raters extracted the data from "difficult" sources. There is a possiblity of errors and misstakes in that process.
First we thought about "Cohans Kappa". But we are not sure how to use this with multiple variables and if it is the right solution for our needs. Maybe there is another statistical methode better fitting to our needs?
The point is we don't want to give Kappa for each variable. We want one Kappa (or something else) for the complete process (two raters, multiple variables).