# Tagged Questions

Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

12 views

### Alternatives to Google's weighted sort for binomial experiments with n=1

An interesting data scientist interview question: "We are looking at the failure rate for opening files on websites for many clients. We want to rank the files by failure rate; but, with our current ...
15 views

### Regression Using Surveys with Unequal Number of Responses

I am trying to figure out how to properly do regression analysis on a data set from a peer-review survey where individuals in the survey have an unequal number of responses. Below is description of my ...
10 views

### Ranking tests results with a variable number of questions answered

We want to rank the people based on their scores and number of questions answered. They get one question daily and a running test score based on the number of correct answers vs. the number of ...
34 views

### Which proportions are particularly high or low - compare confidence intervals, or logistic regression?

I have a large database of binary decisions (accept or reject), broken down by state of the applicant, so that for each state I can calculate a proportion of positive decisions. e.g. ...
39 views
+50

### How to indicate whether the improvement of a ranking is statistically significant over another one in R?

I have two ranked lists of documents (List1, List2). After comparing each of them against the ground truth, I calculate precision at 5 (P@5) metric to measure how good are each of the ranked lists. ...
30 views

### How can I make Elo ranking system more diversified?

As far as I know, Elo ranking system generates points between 100-2800 generally. However lets say we have 1,000,000 players. Now this range of points is too small. Many players would get the same ...
28 views

### Rank Ordering: Is this a valid method to score different results?

I have a system for handicapping horseraces. I take a given horserace and rank-order the horses in different factors, or categories (I look at things like speed, odds, etc). Say there are 5 horses ...
18 views

### Ranking of the prediction

I am currently using random forest to predict fraud on contracts. Each day, we predict the contract of the past day. The problem is, the guys I am working with keep telling that the value we should ...
4 views

### Algorithm for ranking population elements based on occurrences and sample ranks

I have a finite pool (population) of about 10000 elements. Samples of 100 elements are randomly chosen, and each sample is then ranked based on random element attributes. The 100 elements are then ...
34 views

### Are parametric tests on rank transformed data equivalent to non-parametric test on raw data?

Many non-parametric tests are identical to their parametric equivalent on ranked data. At least, that's what I learned from this blog post on Friedman's test and skimming this 1981 article.. This ...
9 views

### Methods for Developing Weights in Indexes

Example: I am building a macroeconomic index using >10 variables, and these variables, taken together, will numerically rank best and worst countries. What statistical methods/procedures would you ...
6 views

### Finding coefficients for cumulative ranked scores based on training set

I have a list of 20,000 items, ranked based on cumulative score Z with four parameters as follows: Z = A + B + C + D I also have a panel ("training set") of 100 items which I know should be ranked ...
40 views

### Why are gradient boosting regression trees good candidates for ranking problems?

I have been reading up on gradient boosting machines, and in particular GBRT's. I've come across numerous mentions (and finally tracked down some papers) on applying these models to ranking problems - ...
10 views

### How is the weighted version of Kendall's Tau computed? And is there an implementation in R yet?

I could not find a satisfying answer to my question yet. Could someone maybe give me a very simple numerical example how the weighted version of Kendall's tau is calculated? Maybe for the following ...
26 views

### How to select the next matchup to best reduce uncertainty in a ranking

So say I have 30 teams and I want to schedule their games with the objective getting the most information concerning who's better than who as quick as I can. How do I do this. Let's say we have a ...
27 views

### Ranking Data Comparison

I'm currently analyzing my experimental data and I have a question about comparing two variables. In the experiment I have a question which asks respondents to rank a set of pictures based on their ...
25 views

### How to compare three groups ranking a set of items?

I have six photos which the test subjects rank according to their preference. So the response per person is six columns, "Rank of photo A" to "Rank of photo F". I am grouping the subjects by ...
20 views

### Trying do determine how to rank water flow measurements?

I'm doing a study that involves waterflow measurements as it relates to erosion prioritizing. I'd like to rank between (0-1) a population of 160 values with a minimum of 2.1 and a maximum of 5.9 The ...
66 views

### Where do the default values in the Elo ratings formulas come from?

After doing some reading about the Elo ratings system, I am trying to implement one. I have some questions on the default values in the formulas. If player A has rating $r_a$ and player b has rating ...
8 views

### Ranking data sets by means etc. (unequal sample size and variance)

I want to rank several lists of data by their tendency to be larger or their capacity to be larger when extrapolated. Is there a way to do this effectively?
9 views

### How do I treat binary variables when creating a rank for different companies

I am currently doing a project to create a rank for different companies base on numbers of metrics that are available to me. My first thought is to normalize all the numerical variables. I am ...
37 views

### How Do I Rank the GPA of Students from Different Colleges?

I have data from 100 students, each at a different college would like to rank them by GPA. I have the following data for each: The student's GPA: example 3.25 The all student average: 3.10 The ...
12 views

### best approach to model search ranking for an ecommerce site

I am trying to build a model to rank search results in my ecommerce site. I am ideally trying to rank results that are relevant to the user query and in turn would result in a sale. I have text score ...
47 views

### I have 12 items to get into a single rank order. Can I get this from having a few hundred people see a set of 10 of the possible pairs of items?

I attempted to run a study where people had to rank order 12 statements from best to worst. However, it was extremely messy and difficult for people to rank that many items. Now, my professor and I ...
35 views

### methods to validate effectiveness of ranking system?

I seek to compare the effects of different rating-based ranking methods and examine which ranking would lead to higher sales (i.e., which is ranking is superior to increase customer conversion rate). ...
25 views

### Learning to Rank with no queries

I want to rank (order by relevance) some data, and I currently have some labeled observations (relevance scores given by a user) and some unlabeled observations. I'm currently studying learning to ...
44 views

### Can rank variables be iid?

I'm curious about the responses to some questions I've found on this site -- but I can't post comments yet, so I am starting a new question. At least two people have asked about regression to predict ...
44 views

### weighting matches by time and variance

I'm putting together a rating system for hockey teams and have data on the number of goals conceded for each team in each game. I would like to come up with a weighting that gives less erratic results ...
5 views

### Ranking districts (on basis of % cahnge) after controlling initial conditions

We want to rank Indian districts as good/bad/average performer on the basis of change in access to latrine between 2001 and 2011. We calculate the percentage point change in access to latrine ...
11 views

### Score Scaling for ranking problems

I am working on a problem, where I might want to switch out between Model A and Model B both of which are used to make recommendations of the type >. The scores are in descending orders. The output of ...
45 views

### Normalization of values

How do I normalize a set of data? Let's say we are looking at measurements of diameter of the heart in women and men. Men will have bigger hearts, so error in measuring by the observers will always be ...
41 views

### How to perform ordinal regression with rank-based dependent variable?

I have a dataset I'm about to use for some preliminary testing. However, I've stumbled onto a puzzle which I cannot seem to figure out. ...
28 views

### Modeling bias in reviews of conference papers

An article in Science Magazine claims that A little bias in peer review scores can translate into big money, simulation finds . The paper referred to there is paywalled, though. Can anyone point me to ...
43 views

### Weighted arithmetic mean's alternative for ranking items

I have a Blog post ranking algorithm which has 5 factors which are considered for calculating final score. I have predefined input range according to which i decide score of a factor. e.g. Factor : ...
22 views

### Averaging rankings of small geographical areas to find an average ranking for a larger area

I have a friend who is very intelligent with a professional background in accountancy but no formal mathematical or scientific training. He is studying for a PhD (as a mature student) looking at how ...
18 views

### Specifying an HLM model in SPSS (ranking data)

In SPSS, I am receiving the error: The final Hessian matrix is not positive definite although all convergence criteria are satisfied. And when looking at the output, it is telling me that the ...
95 views

### Ranking features in logistic regression

I used Logistic Regression. I have six features, I want to know the important features in this classifier that influence the result more than other features. I used Information Gain but it seems that ...
60 views

### Models that can rank relative performance among teams?

I'm looking for help towards finding a proper model for the problem I'm facing. I have a data set of teams that face each other and have a binary outcome Win/Lose. I want to establish some sort of ...
12 views

### Paired test (non-independent) for rank order data

I have responses from a survey with questions where respondents were asked to rank their top 3 choices from a list of 8 choices. An example of the type of question would be to rank their top 3 methods ...
57 views

### Test/Measure for Rank Ordering a Logistic Regression model, invariant to event rate and population size

I have a model whose purpose is to rank order event risk - the output of which is split into twentiles (which have been based off the benchmark data). Currently, I'm using Somers' D calculated on ...
21 views

### Adding Factor Scores after PCA to create index

I am creating a single index and have narrowed my variables down to two Components using Principal Components analysis (varimax rotation). I have a ton of literature/theory that states that the two ...
23 views

### Mean Rank Order Format

my apologies for my obvious lack of knowledge in the matter, however I am currently doing an assignment in which we had to conduct a mini research study in order to assess our SPSS skills. One of the ...
29 views

### Clustering with restrictions

I have this dataset of a ranking of roughly 32.5k players in increasing order. The third column contains the number of players which have the corresponding score, whilst the second is the number ...
39 views

### help with computing standard score for scarce discretely quantized data

I'm not a stats major and I'd appreciate any help I can get. I've got data with each point defined by a score (between 0-1) and a frequency (0-100%). At 100%, the score is most reliable, at 1% the ...
15 views

### Survey ranked choices bigger population of choices visualization and significance testing

A little bit of background, this is about Magic: the Gathering. Out of a pool of maybe 40 viable Legacy decks, experts were asked to rank the 5 decks they thought were best. This means we don't have ...
51 views

### How U.S. News college ranking works

I am interested in the model/algorithm that they use to evaluate college ranking. Any ideas? Regression or simply weighting system
39 views

### Creating a rank on performance and size

Ranking is not something that I need to do particularly frequently in my job and its probably the weakest part of my statistics background. I have a dataset containing a list of items and a ...
43 views

### What are good resources on Bayesian rating?

I am figuring out how to build a ranking system for movies using IMDB data. My own dataset related exclusively to "art movies", so they would tend to have fewer reviews than the average IMDB movie ...
Say I have an experiment running and I collect data for $n$ different settings for some variable $x$ and I collect $n$ different distributions of results, each with a different mean and standard ...