I'm analysing a study of 4 raters and 34 subjects. I'm looking at the inter rater reliability. For the ordinal results, I did a weighted kappa of Fleiss and for the other continuous results I calculated an ICC (2,1).
My question is if the data has to follow a normal distribution to be able to use the Kappa of Fleiss and the ICC (2, 1) correctly?