My question follows from a previous excellent response in another post:
Intra- and inter-rater reliability on the same data
Wow, what a truly great response! I am running through a similar problem and I wondered if someone would be able to expand this example to a dataset similar to the one you created but with 2 measurements per patient, per rater, to allow for calculation of intra-rater reliability? And with scoring based on a 1-6 scale instead of a binary response?
The dataset would look like this:
+-------------------------------------------------------------+
| a1 a2 b1 b2 c1 c2 d1 d2 Time Patient |
|-------------------------------------------------------|
| 3 2 1 2 1 4 2 1 1 1 |
| 4 4 3 5 1 5 2 1 2 1 |
| 1 2 2 5 3 5 1 3 1 2 |
| 2 1 3 5 2 6 1 1 2 2 |
| |
+-------------------------------------------------------------+