Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

learn more… | top users | synonyms (1)

0
votes
1answer
12 views

Alternatives to Google's weighted sort for binomial experiments with n=1

An interesting data scientist interview question: "We are looking at the failure rate for opening files on websites for many clients. We want to rank the files by failure rate; but, with our current ...
1
vote
1answer
15 views

Regression Using Surveys with Unequal Number of Responses

I am trying to figure out how to properly do regression analysis on a data set from a peer-review survey where individuals in the survey have an unequal number of responses. Below is description of my ...
0
votes
0answers
10 views

Ranking tests results with a variable number of questions answered

We want to rank the people based on their scores and number of questions answered. They get one question daily and a running test score based on the number of correct answers vs. the number of ...
0
votes
1answer
34 views

Which proportions are particularly high or low - compare confidence intervals, or logistic regression?

I have a large database of binary decisions (accept or reject), broken down by state of the applicant, so that for each state I can calculate a proportion of positive decisions. e.g. ...
0
votes
0answers
39 views
+50

How to indicate whether the improvement of a ranking is statistically significant over another one in R?

I have two ranked lists of documents (List1, List2). After comparing each of them against the ground truth, I calculate precision at 5 (P@5) metric to measure how good are each of the ranked lists. ...
3
votes
1answer
30 views

How can I make Elo ranking system more diversified?

As far as I know, Elo ranking system generates points between 100-2800 generally. However lets say we have 1,000,000 players. Now this range of points is too small. Many players would get the same ...
0
votes
1answer
28 views

Rank Ordering: Is this a valid method to score different results?

I have a system for handicapping horseraces. I take a given horserace and rank-order the horses in different factors, or categories (I look at things like speed, odds, etc). Say there are 5 horses ...
0
votes
0answers
18 views

Ranking of the prediction

I am currently using random forest to predict fraud on contracts. Each day, we predict the contract of the past day. The problem is, the guys I am working with keep telling that the value we should ...
0
votes
0answers
4 views

Algorithm for ranking population elements based on occurrences and sample ranks

I have a finite pool (population) of about 10000 elements. Samples of 100 elements are randomly chosen, and each sample is then ranked based on random element attributes. The 100 elements are then ...
5
votes
1answer
34 views

Are parametric tests on rank transformed data equivalent to non-parametric test on raw data?

Many non-parametric tests are identical to their parametric equivalent on ranked data. At least, that's what I learned from this blog post on Friedman's test and skimming this 1981 article.. This ...
0
votes
0answers
9 views

Methods for Developing Weights in Indexes

Example: I am building a macroeconomic index using >10 variables, and these variables, taken together, will numerically rank best and worst countries. What statistical methods/procedures would you ...
0
votes
0answers
6 views

Finding coefficients for cumulative ranked scores based on training set

I have a list of 20,000 items, ranked based on cumulative score Z with four parameters as follows: Z = A + B + C + D I also have a panel ("training set") of 100 items which I know should be ranked ...
1
vote
1answer
40 views

Why are gradient boosting regression trees good candidates for ranking problems?

I have been reading up on gradient boosting machines, and in particular GBRT's. I've come across numerous mentions (and finally tracked down some papers) on applying these models to ranking problems - ...
0
votes
0answers
10 views

How is the weighted version of Kendall's Tau computed? And is there an implementation in R yet?

I could not find a satisfying answer to my question yet. Could someone maybe give me a very simple numerical example how the weighted version of Kendall's tau is calculated? Maybe for the following ...
2
votes
1answer
26 views

How to select the next matchup to best reduce uncertainty in a ranking

So say I have 30 teams and I want to schedule their games with the objective getting the most information concerning who's better than who as quick as I can. How do I do this. Let's say we have a ...
2
votes
1answer
27 views

Ranking Data Comparison

I'm currently analyzing my experimental data and I have a question about comparing two variables. In the experiment I have a question which asks respondents to rank a set of pictures based on their ...
0
votes
0answers
25 views

How to compare three groups ranking a set of items?

I have six photos which the test subjects rank according to their preference. So the response per person is six columns, "Rank of photo A" to "Rank of photo F". I am grouping the subjects by ...
1
vote
1answer
20 views

Trying do determine how to rank water flow measurements?

I'm doing a study that involves waterflow measurements as it relates to erosion prioritizing. I'd like to rank between (0-1) a population of 160 values with a minimum of 2.1 and a maximum of 5.9 The ...
5
votes
2answers
66 views

Where do the default values in the Elo ratings formulas come from?

After doing some reading about the Elo ratings system, I am trying to implement one. I have some questions on the default values in the formulas. If player A has rating $r_a$ and player b has rating ...
0
votes
0answers
8 views

Ranking data sets by means etc. (unequal sample size and variance)

I want to rank several lists of data by their tendency to be larger or their capacity to be larger when extrapolated. Is there a way to do this effectively?
0
votes
0answers
9 views

How do I treat binary variables when creating a rank for different companies

I am currently doing a project to create a rank for different companies base on numbers of metrics that are available to me. My first thought is to normalize all the numerical variables. I am ...
1
vote
1answer
37 views

How Do I Rank the GPA of Students from Different Colleges?

I have data from 100 students, each at a different college would like to rank them by GPA. I have the following data for each: The student's GPA: example 3.25 The all student average: 3.10 The ...
0
votes
0answers
12 views

best approach to model search ranking for an ecommerce site

I am trying to build a model to rank search results in my ecommerce site. I am ideally trying to rank results that are relevant to the user query and in turn would result in a sale. I have text score ...
4
votes
1answer
47 views

I have 12 items to get into a single rank order. Can I get this from having a few hundred people see a set of 10 of the possible pairs of items?

I attempted to run a study where people had to rank order 12 statements from best to worst. However, it was extremely messy and difficult for people to rank that many items. Now, my professor and I ...
0
votes
0answers
35 views

methods to validate effectiveness of ranking system?

I seek to compare the effects of different rating-based ranking methods and examine which ranking would lead to higher sales (i.e., which is ranking is superior to increase customer conversion rate). ...
0
votes
1answer
25 views

Learning to Rank with no queries

I want to rank (order by relevance) some data, and I currently have some labeled observations (relevance scores given by a user) and some unlabeled observations. I'm currently studying learning to ...
2
votes
1answer
44 views

Can rank variables be iid?

I'm curious about the responses to some questions I've found on this site -- but I can't post comments yet, so I am starting a new question. At least two people have asked about regression to predict ...
1
vote
1answer
44 views

weighting matches by time and variance

I'm putting together a rating system for hockey teams and have data on the number of goals conceded for each team in each game. I would like to come up with a weighting that gives less erratic results ...
0
votes
0answers
5 views

Ranking districts (on basis of % cahnge) after controlling initial conditions

We want to rank Indian districts as good/bad/average performer on the basis of change in access to latrine between 2001 and 2011. We calculate the percentage point change in access to latrine ...
0
votes
0answers
11 views

Score Scaling for ranking problems

I am working on a problem, where I might want to switch out between Model A and Model B both of which are used to make recommendations of the type >. The scores are in descending orders. The output of ...
0
votes
1answer
45 views

Normalization of values

How do I normalize a set of data? Let's say we are looking at measurements of diameter of the heart in women and men. Men will have bigger hearts, so error in measuring by the observers will always be ...
2
votes
1answer
41 views

How to perform ordinal regression with rank-based dependent variable?

I have a dataset I'm about to use for some preliminary testing. However, I've stumbled onto a puzzle which I cannot seem to figure out. ...
1
vote
0answers
28 views

Modeling bias in reviews of conference papers

An article in Science Magazine claims that A little bias in peer review scores can translate into big money, simulation finds . The paper referred to there is paywalled, though. Can anyone point me to ...
1
vote
0answers
43 views

Weighted arithmetic mean's alternative for ranking items

I have a Blog post ranking algorithm which has 5 factors which are considered for calculating final score. I have predefined input range according to which i decide score of a factor. e.g. Factor : ...
1
vote
3answers
22 views

Averaging rankings of small geographical areas to find an average ranking for a larger area

I have a friend who is very intelligent with a professional background in accountancy but no formal mathematical or scientific training. He is studying for a PhD (as a mature student) looking at how ...
0
votes
0answers
18 views

Specifying an HLM model in SPSS (ranking data)

In SPSS, I am receiving the error: The final Hessian matrix is not positive definite although all convergence criteria are satisfied. And when looking at the output, it is telling me that the ...
2
votes
2answers
95 views

Ranking features in logistic regression

I used Logistic Regression. I have six features, I want to know the important features in this classifier that influence the result more than other features. I used Information Gain but it seems that ...
3
votes
2answers
60 views

Models that can rank relative performance among teams?

I'm looking for help towards finding a proper model for the problem I'm facing. I have a data set of teams that face each other and have a binary outcome Win/Lose. I want to establish some sort of ...
0
votes
0answers
12 views

Paired test (non-independent) for rank order data

I have responses from a survey with questions where respondents were asked to rank their top 3 choices from a list of 8 choices. An example of the type of question would be to rank their top 3 methods ...
1
vote
1answer
57 views

Test/Measure for Rank Ordering a Logistic Regression model, invariant to event rate and population size

I have a model whose purpose is to rank order event risk - the output of which is split into twentiles (which have been based off the benchmark data). Currently, I'm using Somers' D calculated on ...
0
votes
0answers
21 views

Adding Factor Scores after PCA to create index

I am creating a single index and have narrowed my variables down to two Components using Principal Components analysis (varimax rotation). I have a ton of literature/theory that states that the two ...
0
votes
0answers
23 views

Mean Rank Order Format

my apologies for my obvious lack of knowledge in the matter, however I am currently doing an assignment in which we had to conduct a mini research study in order to assess our SPSS skills. One of the ...
0
votes
0answers
29 views

Clustering with restrictions

I have this dataset of a ranking of roughly 32.5k players in increasing order. The third column contains the number of players which have the corresponding score, whilst the second is the number ...
0
votes
0answers
39 views

help with computing standard score for scarce discretely quantized data

I'm not a stats major and I'd appreciate any help I can get. I've got data with each point defined by a score (between 0-1) and a frequency (0-100%). At 100%, the score is most reliable, at 1% the ...
0
votes
0answers
15 views

Survey ranked choices bigger population of choices visualization and significance testing

A little bit of background, this is about Magic: the Gathering. Out of a pool of maybe 40 viable Legacy decks, experts were asked to rank the 5 decks they thought were best. This means we don't have ...
1
vote
1answer
51 views

How U.S. News college ranking works

I am interested in the model/algorithm that they use to evaluate college ranking. Any ideas? Regression or simply weighting system
3
votes
2answers
39 views

Creating a rank on performance and size

Ranking is not something that I need to do particularly frequently in my job and its probably the weakest part of my statistics background. I have a dataset containing a list of items and a ...
1
vote
1answer
43 views

What are good resources on Bayesian rating?

I am figuring out how to build a ranking system for movies using IMDB data. My own dataset related exclusively to "art movies", so they would tend to have fewer reviews than the average IMDB movie ...
0
votes
0answers
15 views

Methods for ranking measurements with different confidence

Say I have an experiment running and I collect data for $n$ different settings for some variable $x$ and I collect $n$ different distributions of results, each with a different mean and standard ...
0
votes
0answers
33 views

comparing ranks for a multinomial distribution between sample and population

I have a known multinomial distribution of a population due to a census. I want to compare a sample with this population. I want to know the probability that the same ranking of the classes of the ...