I would like to calculate the inter-rater reliability between 3 raters for some kind of time-series. Actually, I'm not quite sure, if I can call my data time-series but I will give you an example, so hopefully, you will get my idea then.
I do some ratings of the behavior of persons in a video. There are 4 categories (can be treated as ordinal data) and there will be a rating for each time frame. So, the data will somehow look like this.
|Time frame||Rater 1||Rater 2||Rater 3|
And I have this kind of data for every person (approx. 30 persons). Now, I would like to calculate, if the raters agree on their ratings over all persons. I tried to google it, but I just found inter rater reliability indices in cases of one rating for each person and not for these multiple time points.
Maybe somebody has an idea.
Thank you in advance :)