Skip to main content
Bumped by Community user
Edited title to make it a question and added reliability tag
Link

How can I calculate inter-rater agreement when you askfor two raters to rank a set of things in preferred order of preferenceassigning ranks?

Source Link
vs121
  • 11
  • 1

calculate inter-rater agreement when you ask two raters to rank a set of things in preferred order of preference

I am new to statistics and currently trying to calculate the inter rater agreement between two entities based on their rankings of a set of things. For example if i give person 1 a set of 5 things and ask him to rank them based on order of preference and give the same set to person 2 and ask him to rank what he prefers how would i calculate their inter rater agreement?

I read about the ways to calculate and i guess the closest method it would resemble are methods used for Likert scales(i may be way off here!) but i am not sure it exactly fits my problem here. Can anybody help me with this?

Thanks!