I have a dataset of 1000 candidates whom I have assessed for a skill. I have calculated accuracy of correct answers of each user as well as efficiency of each user based on number of attempts taken by a user to solve a problem. Both these metrics are in percentage form. Now I want to give rank to each user based on their accuracy and efficiency. Both the metrics are equally important.

What statistical methods are best suited to do this ranking?


Did you have a look at this? If you'd like to be conservative in your ranks for either of the metrics then computing the conservative skill estimate for that metric for each candidate of say about $\mu-3\sigma$ and then sorting by that should be fine.


One method that seems apparent immediately to me would be the product of those two columns.

Suppose your data looked like this:

accuracy    efficiency
0.85        0.87
0.75        0.95
0.8         0.9
0.6         0.5
0.6         0.7
0.7         0.8
0.95        0.9
0.98        0.6
0.45        0.6
0.85        0.79

If both columns are equally weighted, why not try accuracy * efficiency for your metric? This would sort of give you the "best" candidate by this particular metric.

You'd end up with this column:


Then you can use Excel's RANK function on product to order your candidates. Or just sort descendingly on product.

Maybe there are more sophisticated ways, but this is a quick win in my book.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.