I am trying to calculate interrater reliability in SPSS for both pre and post test of the same measure that is administered as part of a prison intake program. The measure has 20 items and then a total score. I am just running on total score agreement.
I ran crosstabs and calculated kappa for the pretest and correlations. Is that all I need to do? Is there more that would be helpful to report for publication?
Also, I have one rater that I suspect is a problem. I also want to use this information for training raters. How can I identify how error associates with an individual rater?
If you could tell me your thoughts for SPSS, that would be helpful. I am learning R, but am currently completely R illiterate.
Thanks for any information.