Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ranking]

Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the [rating] tag, too.

0
votes
0answers
18 views

Number of unique values for rank correlation to be valid

Are there any recommendations on a minimum number of unique rank values per variable for either rank correlation coefficient or significance of this coefficient to be valid. Is it recommended to ...
1
vote
0answers
51 views

How to correlate movie taste?

I am looking for the best known way to correlate movie taste, i.e. to determine which people out of a large pool deviate the least from your own movie scores. One site with this purpose is Criticker. ...
0
votes
0answers
11 views

Power rank/Composite score help needed

I've been assigned to create a power rank for 160 call centre market research employees (called interviewers). Getting more into it, I realise the necessity of statistics. Now, for some reason, when I ...
0
votes
1answer
27 views

What model should I use?

I was having a discussion with my father about building an index that ranks cities as a function of multiple variables. For example, ranking n=20 cities based on $$$/SQFT and air quality. I would ...
0
votes
0answers
15 views

Ranking features

I am currently working with a dataset in which I have provided a numerical value (0 to 3) to different regions on a subject. The values correspond to the severity of the region affected (0 - not ...
0
votes
0answers
11 views

How to compare the rankings of two groups?

I'm trying to compare the rankings of two different groups (states that voted Democrat and states that voted Republican). What test should I use? Based on some googling, it seems that I should be ...
0
votes
0answers
7 views

Calculate score from weighted events

I need to calculate a score with range 0 - 100. The score is calculated from 2 types of weighted variables (weight allowed from 0 to 1): 1)Numerical based on population, examples: - Number of ...
6
votes
1answer
97 views

Correlation between an observation and its rank in a random sample

Suppose $X_1,X_2,\ldots,X_n$ are i.i.d random variables with an absolutely continuous distribution. We say the observation $X_i$ has rank $R_i$ if $$X_i=X_{(R_i)}\quad,\,i=1,2,\ldots,n,$$ where $X_{(...
1
vote
0answers
25 views

How to quantify the uncertainty in a single value obtained from a large number of simulations

Im a physics student working on a project in which I have to simulate a machine that would order a bunch of molecules according to their mass. I want to get a quantitative measure of how well the ...
0
votes
0answers
27 views

How to convert t statistic into a stanine score?

This link:- Stanine definition talks about Stanine score. It says : The underlying basis for obtaining stanines is that a normal distribution is divided into nine intervals. In reality I won't know ...
0
votes
0answers
25 views

Ranking with Z-Score

I am (new) trying to learn more about statistics and how to apply models to different problems. As practice, I came across the idea of ranking schools based on their ACT, SAT, and exam average scores ...
1
vote
1answer
34 views

Can two imperfect rankings be combined to produce a better ranking?

So I've got a dataset that can be ranked in two noisy ways $R_1$ and $R_2$. Let's call $R_1$ and $R_2$ functions from the dataset $x \in R^N$ to a real number between 0 and 1. Since they are rankings ...
0
votes
0answers
24 views

ranking metric for a specific use case

I am trying to find the best "ranking metric" for my problem but could not find any existing suitable metric, can someone help. I'm interested in information retrieval. For item there is a "...
0
votes
0answers
12 views

Using clickthrough data for training a ranking function

Suppose that you have clickthrough data in the following form -- (query, clicked url, frequency). I wonder if there is any way of using the data to train a ranking function. Naively, you can treat ...
0
votes
0answers
8 views

Regarding ranked networks from Pearson correlation data

I have constructed a Pearson correlation network between the entities in my data (genes in this case). I want to assign ranks for the PCCs for each node at a time. The following example is for the ...
0
votes
0answers
22 views

Do all robust estimators involve ranking?

Are there any robust estimators that do not include ranking as part of their method?
0
votes
0answers
9 views

Ranking based on number & production of referrals

I have a list of approximately 250 referrers that I need a better ranking system for. I have tried ranking strictly by productivity of referrals however that often results in a ‘one off’ doctor being ...
2
votes
0answers
31 views

What is the name of this test for the probability of differences between lists and is it valid?

And are there any better methods? In a 1969 book about investing, the author Burton P. Fabricand describes a method for assessing the effectiveness of a stock picker. Ask the picker to provide a list ...
3
votes
2answers
65 views

Is ratio of ranks a well-studied statistic?

I have two lists of recommendations: that is, two different algorithms have assigned ranks to the same list of objects. I would like to know if they're similar. I specifically care more about ...
0
votes
0answers
8 views

Fitting heteroscedastic noisy rank data

I am trying to fit a model from a continuous independent variable to a rank that starts from 0 and increases. What the rank indicates and what the independent variable is, is beyond the scope of this ...
0
votes
0answers
15 views

Expected average precision for random ranked list

Suppose we are evaluating the label ranking average precision (LRAP), which is an evaluation metric used to compare a ranked list to a ground truth (binary) label vector. Background and Definition ...
1
vote
0answers
22 views

Using Class Probabilities from Random Forest to do Ranking

Assume that we have set of documents which are being labelled as relevant and non-relevant. Can I used the class probabilities generated by Random Forest in python scikit-learn to rank the documents ...
1
vote
0answers
17 views

Random Forest in RankLib

I am building a LETOR model using Random Forest with RankLib. As we know that the Random Forest gets better with higher number of trees, I got a totally different observation in my case. The ...
0
votes
1answer
18 views

Robustness of ranking based on cross validation set, should I bootstrap?

I have a dataset that I separate into training and validation. I fit several models on the training set and then evaluate their performance on the validation set. When I rank the models based on their ...
0
votes
0answers
14 views

Rank Test for a Matrix

Suppose I have a matrix A corrupted with noise and I am looking for a test that tests the null hypothesis that the matrix A, rank(A)==1 v.s. rank(A)>1. I checked a little the literature and this paper ...
0
votes
0answers
15 views

Directly optimizing over AUC surrogate

This is in relation to this paper I am looking for ways to optimize Recall @ fixed Precision ($R@P$) for a machine learning problem and i didnt want to use accuracy as a proxy for $R@P$. Upon ...
0
votes
0answers
11 views

Somers' D deteriorating for more granular rankings

Background I have 30 observations and I want to compare how much experts and model agree with each other. For Model and Expert I have slots which are $\in [1,4]$ and ranking which are $\in [1,30]$. ...
1
vote
1answer
40 views

Assigning probabilities to processes, when you know which probabilities exist but not which one belongs to which process

I have multiple stochastic processes that can have 2 different realisations. I think of them as coins that can take the values heads or tails. For the example I assume that there are 3 coins. I know ...
1
vote
0answers
27 views

Merging three rankings about economic relations

I am facing a -probably- simple or stupid problem, however I don't have the prequisite knowledge. I would like to make an overall ranking, to compare bilateral economic relations (during a given time-...
2
votes
0answers
33 views

Skill-based ranking system with individual performance

I am attempting to rank players in an online game and have successfully used TrueSkill to create a good ranking system however I would like to take it a step further and let individual performance ...
0
votes
0answers
17 views

Scaling/weighting probabilities

I have data which looks like the table below. I am provided with the likelihood of a game to occur (Prob) and the current time in min for that game (Curr_time_min). I would like to create a formula ...
0
votes
1answer
21 views

Ranking Order Test

I am analyzing my capstone data - I had students, from different grades, rate 6 feedback forms from 1-6, where 1 was the most helpful feedback type and 6 the least helpful feedback type. Is there a ...
0
votes
0answers
13 views

How are ranks defined in Page's trend test?

I'm confused about the two kinds of rank in a Page test with $n$ conditions and $k$ subjects. Wikipedia says the $i$th condition receives a rank $Y_i$ and a sum $X_i$ over the subjects' ranks. In ...
1
vote
0answers
26 views

What is the expected fraction of observations in the top x% that remains in the top x% after a random shock?

I'm struggling with a probability question, and I was hoping someone here could help me out. Here's the setting. Suppose you draw observations from a probability distribution Z and sort these ...
1
vote
1answer
22 views

Score ordinal ranking configuration according to an optimal ranking

I have a list of items, each associated with their optimal ranking in the list. How can I give a score to a given order of the list. For instance, if I know that the optimal ranking is: 4 3 5 1 2 And ...
2
votes
0answers
38 views

Elo-type ranking system that incorporates game score

The Elo rating system is used to calculate relative skill levels between individuals or teams. It can be applied to many types of games and sports, but when applied, it only considers wins and losses. ...
0
votes
0answers
18 views

Score to assess ranking of predicted outcomes

Is there any quantitative measure to evaluate a predictive model's ability rank units correctly. For example, I am trying to predict a continuous outcome. The error of my predicted versus actual value ...
0
votes
0answers
18 views

Pairwise comparison for differences between Coefficient of Variation Ranking between groups

I would like to test whether the ranking obtained by ordering the coefficient of variation of some genes are different or not between two groups, and do it pairwise, so, row by row, and get a p-value ...
0
votes
0answers
32 views

What comparative analysis can I use for rank ordered data, divided into two groups, from a survey questionnaire?

I have a dataset from a survey questionnaire. Let's say I can divide the participants into group A and B based on a screening question. These participants then rank 7 different options in order from ...
0
votes
0answers
9 views

Measuring the cost of the prediction error when picking the maximum value in a sequence

I have several entities denoted as a set $A=\{1, \ldots, K\}$. They form a sequence $(y_n)_{n\in A}$ with $y_i\in \mathbb{R}$. The values of $y_i$ are unobservable and get estimated as $\hat{y}_i$. ...
4
votes
1answer
43 views

Is there a way to estimate the minimal number of pairwise comparisons required to place complete ordering over a set of items?

I have 200 items that I need users to compare. If there are 2 items, A and B, then the comparison is A before B or B before A. ...
0
votes
0answers
25 views

Compare two set

I want to compare two sets of values with a ranking. I want to have more of a similarity coefficient. My goal is to take into account both aspects: the similarity on the ranking and the similarity on ...
1
vote
0answers
18 views

Ranking items through votes

I asked participants to rank 10 items based on order of importance (i.e. 1=most important 10=least important 11=not relevant Now, I want to order the items from most voted important to least ...
0
votes
0answers
26 views

Comparing different ranking methods' results

I have been looking for literature about comparing the retrieval results of two methods. One method results in a list of ranks whereas the second method results in a list of sets of ranks. Do you have ...
0
votes
0answers
56 views

Internal consistency

I have to analyse a dataset in which there are drugs and used animals based on article review. The datasets looks like this: ...
1
vote
0answers
20 views

Making sense of AICc ranking vs. R2 and standardized coefficients

Mixed/hierarchical models and model ranking is fairly new to me. I'm just wondering if someone can help me make a little more sense out of this.... I used the lmer() to build 7 linear mixed effects ...
0
votes
0answers
8 views

Computing score ( relative score) for % Values distribution : Need review

I have a survey % values in the following order ...
1
vote
0answers
26 views

Get final rank from ranked list [duplicate]

i got exactly same problem with this question Overall rank from multiple ranked lists but i didnt get any references and answer for that. example : ...
0
votes
0answers
7 views

Aggregate main criteria and sub-criteria in AHP

When using AHP, there are main criteria and sub-criteria. One of the important step is to create the Criteria-alternative decision matrix. In case there are 6 main criteria and 20 sub-criteria. How ...
1
vote
0answers
31 views

At which rank should I reasonably stop selecting interview candidates?

It seems that my problem could be classified as an "optimal stopping" problem, but I am unable to make much of this information. It is an important problem for my organisation (an NGO), in order to ...