I have two observers who both looked at several scans we performed in patients. They both looked at all scans, they were blinded to clinical data and each others measurements, and they scored several things:
- whether the scan was abnormal (1 or 0)
- how bad it was (from 1 to 5)
- and they measured something using computer software (continuous variable, measurements usually between 2.50 and 7.50)
Now I read my old statistics book, which tells me for categorical variables and 2 observers, I can use Cohen's kappa. Is this correct?
For continuous variables, the book says I should use the intraclass correlation coefficient, but if the two observers are not systematically different (as assessed by a paired T-test, i.e. one observer does not consistently measure higher or lower as the other), this would be practically the same as using the Pearson's correlation coefficient. Is this also correct?
And what test should I use for the binomial variable?
Thanks for your help.