I have obtained a Fliess' Kappa interrater reliability of $37.5\%$ from $90$ randomly selected raters rating $100$ randomly selected, binary items ($Yes/No$).
Question: Is the following interpretation technically correct?
After accounting for the chance-expected agreement, we expect ratings from any 90 raters would genuinely agree with one another on 37.5% of these 100 items.
Note: I'm NOT generalizing to any wider populations of raters or items in my interpretation above. I'm only generalizing to OTHER samples of raters OF THE SAME SIZE.