Ranking means identifying the ordering from highest to lowest or vice versa; statistical ranks are the values 1, 2, 3, ..., up to the sample size, assigned to values or attributes which have the highest (or lowest) rank, the second highest (/lowest) rank and so on.

learn more… | top users | synonyms (1)

1
vote
0answers
14 views

Learning to Rank: query-dependent vs. query-independent features

I've been doing some reading about learning to rank - specifically lambdaMART - and one thing I am confused about is the role of features. When training a model, should one only use query-dependent ...
1
vote
0answers
9 views

Is there an equivalent to Lower bound of Wilson score confidence interval for variables with more outcome

After reading "How Not to Sort by Average Rating" (http://www.evanmiller.org/how-not-to-sort-by-average-rating.html), I was curious to know if there was the same thing for variables with more than two ...
0
votes
0answers
12 views

Ranking based on multiple parameters

I am xyz organization. I have recruit entry level engineers from 100 colleges. I have their performance, attrition & promotion data for last 3 yrs. I have 4 parameters performance, promotion, ...
0
votes
0answers
6 views

Analysing a rating scale with many predictor variables

My response variable is derived from a question in which respondents expressed a preference score (from 1 (do not like) to 10 (like alot)) for a range of scenarios. I would like to analyse this data ...
1
vote
0answers
15 views

Regularization in unordered vectors

Let suppose we are given two vectors u, v $\in \mathbb{R}^n$ and we want a function that returns $0$ if the ordering of the elements of both vectors are the same or a positive number otherwise, where ...
1
vote
1answer
25 views

How to statistically determine if something appears in the beginning of a vector

I have multiple vectors of letters, in which an entry can appear multiple times. The vectors are of variable length. ACBDEABAEE ACDE ACBDBBDDE I want to ...
0
votes
1answer
26 views

Aggregate ranking from multiple ranked lists

I have multiples lists which are ordered. How do I generate a final list with all elements in all lists ranked by their cumulative rank? I.e. the Final column here: ...
1
vote
0answers
32 views

Better markov chain rank aggregation using an entropy-based approach

Background: Dwork et al. in Rank Aggregation Methods for the Web have proposed a few markov chain-based methods to perform rank aggregation (finding an aggregated ranking of items from a set of N ...
3
votes
0answers
34 views

How to measure the reliability of a consensus ranking (problem from Kemeny-Snell book)

Suppose that $k$ experts are each asked to rank a set of $n$ objects in order or preference. Let allow ties in the rankings. John Kemeny and Laurie Snell in their 1962 year book "Mathematical models ...
0
votes
0answers
28 views

How to normalize ranked data

I am doing some machine learning and need help with the stats aspect of my problem. I have a number of addresses of webpages and some features for these webpages. I am running TF-IDF on the webpage ...
0
votes
0answers
5 views

When measuring attitudes, does rank-ordering choices have any advantages over rating choices?

I can see an advantage for rating in that you potentially end up with interval data rather than ordinal data. However, I'm struggling to think of what potential advantages there might be to ...
0
votes
0answers
21 views

Correlating ranked lists

Let's assume I have 10 users who rank a list by preference. A B C etc. My questions are: What is the best statistical method to find which lists are the most correlated? If they are the same, ...
2
votes
0answers
33 views

What is a robust way to find the max of $n$ independent, non-identical random variates?

Suppose I observe $n$ random variates along with their variance (but not mean) and I'd like to select the one with the largest mean as frequently as possible. The procedure must be memoryless--you ...
0
votes
1answer
64 views

Fisher's exact test for gene rank enrichment

I'm trying some metrics to filter a list of gene names with associated numerical values which correspond to their abundance. I'm looking for some interesting genes and trying to see if they come up ...
4
votes
1answer
421 views

If C wins B 80% of the time, and B wins A 80% of the time, how often would C beat A?

I am currently trying to better understand probabilistic skill ranking systems for games, but I find that I have trouble properly understanding the basic concept of how skill as a pairwise comparison ...
4
votes
0answers
35 views

Ranking undergrad students by their future income - Mixture distribution

I would be very grateful for some advice on how to model mixture distributions with R. Given a problem to create a ranking of graduate students by their yearly income after completing their ...
1
vote
2answers
133 views

What is the name of the survey method for determining the rank order of multiple items using a multiple question process?

I have seen surveys that use the following method to rank multiple items against each other. Let's say you have 25 items and you want to know their rank order (according to the survey-taker's ...
0
votes
0answers
13 views

Using BTL2 : Can we fix the scale of the ability-scores?

Using the Bradley Terry Luce 2 model: We want to rank 41 scripts by paired-comparison (package BTL2). But our dataset is incomplete. We can generate ability scores, but the scores at the end of the ...
1
vote
0answers
42 views

How to calculate ratings/rankings from Paired comparison / Pairwise comparison of large data-sets?

As part of my graduate thesis (area: psychology) I have gathered preference data. The data includes approximately 50000 heads-up comparison between elementX and elementX. I have a total of 15 ...
1
vote
0answers
20 views

Modeling a list with a tunable degree of disorder/shuffling

Imagine we have a list of ordered numbers $L = (1, 2,\dots, N)$. I want to add an arbitrary amount of "disorder" to that list. For instance: Adding a little bit of disorder would permute a few ...
0
votes
1answer
34 views

How to apply Laplace rule of succession for any possible value in a range?

I am looking to have People rate certain items on a scale of 0-10 based on those items perceived utility to the particular Person performing the rating. Fractional values are permitted. Giving no ...
1
vote
1answer
57 views

Sort lists using statistics

I want to make a ranking of music genres. I have a list of artists and top genres with a value (1 - 100) which describes how much their music is from that genre. Now I need to organise the genres so ...
2
votes
1answer
66 views

Re-ranking a list

I have a ranked list say A,B,C,D,E,F,G and a subset of this list ranked with another strategy lets say D,B,C,F. And my assumption is that the strategy used for ranking the sublist is better because ...
0
votes
0answers
33 views

Relationship between expected score and expected rank in a round robin tournament

Suppose you have $n$ players play a round robin tournament. A win adds 1 to the winning score of a player while a loss adds nothing. After the round robin tournament is finished the players are ...
2
votes
0answers
16 views

Evaluation of a semi-supervised ranking model

I learned ranking model with graph-based semi-supervised approach, while labeled (just positive) and unlabeled (positive and negative) data is both used in training. With the model, all of the data ...
0
votes
0answers
33 views

Likelihood of a set of ranks

I'm sorry if I cannot formulate the problem precisely. Let us consider an ordered set $Q$ with $n_q$ elements, and a number of its (possibly overlapping) subsets $B_1, \dots, B_k$. For a given $i$, ...
1
vote
0answers
34 views

Comparing Elo Ranking system with another ranking system

I'm a guy who is interested in computer science and algorithms. I've spent a bit of time recently developing my own ranking system based on PageRank. I'd like to compare it to the Elo system, in ...
0
votes
0answers
41 views

How to rank and compare results of screening tests?

I have a question about how to do analysis of an experiment that has already been done, I hope you can help me with some advice! I will try to keep it as simple as possible, but will give some detail ...
0
votes
0answers
156 views

Hausman test in Stata : rank problem

When I run hausman in Stata, there is the following message: ...
1
vote
0answers
28 views

Analyzing repeated rank data.

I have a data set of N people, T items. Let's say N=100, and T=10. Each person goes through the following exercise. She is shown 2 random items from the set of T=10, and ranks them as rank 1 and ...
0
votes
1answer
43 views

Spearman's Rho - from partial ranked variables

I have two variables which represent two performance measures. I ranked a finite set of elements according these two variables. Therefore, I have to ranks. Suppose the ranks are performed in ...
4
votes
2answers
113 views

Find k of n items with least pairwise correlations

I have a matrix of pairwise correlations between n items. Now I want to find a subset of k items with the least correlation. Thus there are two questions: Which is the appropriate measure for the ...
2
votes
0answers
48 views

Why are ERR (Expected Reciprocal Ranking) scores not normalized?

It seems to me that normalized ERR (Expected Reciprocal Ranking) scores (ERR scores of your ranking algorithm divided by ERR score calculated for the ground truth ranking) are more useful than the ...
0
votes
1answer
54 views

Test to rank methods by AUCs on various benchmarks

Suppose I have N methods and M benchmarks. I have an AUC statistic (and some other similar statistics) for each combination of method with benchmark. What test should I use to test if one method is ...
1
vote
0answers
24 views

How do I predict a person's rank given a set of characteristics?

I'd like to predict a person's rank on a list (1 being top ranked, 50 is last -- ties are allowed, i.e., two people can occupy the #2 rank) given a set of characteristics (e.g., age, occupation, ...
2
votes
1answer
94 views

Rank-sum test and conditional probability

Consider three samples, i.e. three different lists of numbers, A, B and C. The sample sizes of the respective samples might be different. How can I calculate the probability that a draw from sample A ...
0
votes
1answer
83 views

How to estimate Savage scores of tied ranks

I want to calculate the Top-Down Concordance coefficient that quantifies the agreement between two rankings by emphasizing more on the lowest rankings. The original paper is: R.L. Iman and W.J. ...
4
votes
0answers
52 views

Converting a list of partial rankings into a global ranking

I'm working on something like the following problem. I have a bunch of users and N books. Each user creates an ordered ranking of all the books he's read (which is likely a subset of the N books), ...
5
votes
2answers
171 views

Do we need to worry about outliers when using rank-based tests?

Apologies if this is a very basic question. If we have data that are not normally distributed (e.g. skewed, Shapiro-Wilk test is significant) and we resort to rank-based methods (e.g. Wilcoxon Signed ...
1
vote
0answers
80 views

How do i compare NDCG values?

I want to compare different ranking models using the NDCG metric. I average the NDCG of the models, then use the difference between the avg. NDCGs to compare the models. My questions: What does it ...
1
vote
0answers
35 views

How to find the optimum ordering of a set for a nonlinear equation in decent time

Assuming I have an unordered set of tuples of the form: $(a, b)$ How can I order the set so as to optimize the following equation: $\sum_{i=1}^n\sum_{j=1}^{i-1}(a_i*b_i)(1-b_j)$ For small ...
0
votes
0answers
29 views

Comparing cases based on multiple binary variables

A researcher wants to compare 50 websites. There is 80 binary variables for each website that belong to 4 main measures. Actually There is 50*80 matrix that each row represent a website and each ...
1
vote
0answers
33 views

Financial instruments ranking based on price movement (outliers, consistency)

I have a lot of financial instruments and I need to rank them based on price movement "stability", i.e. instruments with with big outliers should have the lowest ranks and instruments with stable and ...
1
vote
0answers
96 views

Item ranking algorithm [closed]

I am developing a website with a lot of different items that can be reviewed and rated, although I need a solid ranking algorithm which I can sort after. The ratings will be performed by the user ...
4
votes
0answers
104 views

Friedman test to report on occurrence of categories in multiple articles

To investigate reasons for certain behavior, we have defined three categories for these reasons, and have determined how often these were mentioned across 15 (very different) scientific articles. ...
3
votes
0answers
63 views

Google consumer survey stats

In Google's consumer survey product, they calculate confidence intervals using the Wilson score interval for the unweighted results. Does anyone know how they calculate the confidence interval after ...
4
votes
1answer
90 views

Validating correctness of ranking algorithm

Stats noob here working on an algorithm for ranking players in a tournament. I have a test set of players, each with a "skill" value. My algorithm simulates a "tournament", in which players play ...
0
votes
0answers
23 views

Analysing different and multiple ranks

In a survey questionnaire I asked participants to give a choice by setting priority/rank to the options as I asked them "What factor motivates a lot for wringing out loyalty, and productivity?", and ...
1
vote
2answers
83 views

Ranking different variables by standardization

I have seven numeric variables and 12 cases. All of them are measures for how well 5 different casinos are performing. The higher the variable, the better the performance. Four of the variables are: ...
3
votes
0answers
97 views

Handling zero scores in “weighted product model”?

I am conducting analysis on 'Multi-Attribute Decision Making (MADM)', where I have two attributes (a1, a2) to characterize the quality of m alternative approaches. The first attribute, a1, is measured ...