I've seen some questions on inter-rater reliability here for categorical variables. I'm wondering what would be an adequate approach to test inter-rater reliability between two raters for a numeric variable ?
- Suppose, for example, that I have two teachers assessing students on a test and I need to check the teachers (aka, raters) reliability. Both teachers will provide numerical scores/grades for the tests.
As far as I'm concerned, both Cohen's Kappa and Weighted kappa are for categorical and ordinal variables (respectively, right?). I've seen approaches to use Cronbach's Alpha or intraclass correlation - ICC or even Pearson's correlation , would any of these be adequate or any other test?
This is more of a theorical question, but tips on calculating this in R Studio would be much appreciated as well. Thanks in advance.