I want to calculate the degree to which the gymnastics judges agree on balance beam scores, i.e., "inter-rater reliability". However, not all judges judge the same candidates, and the number of judges per candidate also varies. There are around 30 judges making roughly 1500 observations.
The data looks like this:
Can you please tell me how to do this statistically, perhaps using Cronbach's alpha?
STATA set-up advice would help, as well.