Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

learn more… | top users | synonyms (1)

0
votes
0answers
5 views

Finding coefficients for cumulative ranked scores based on training set

I have a list of 20,000 items, ranked based on cumulative score Z with four parameters as follows: Z = A + B + C + D I also have a panel ("training set") of 100 items which I know should be ranked ...
1
vote
1answer
26 views

Why are gradient boosting regression trees good candidates for ranking problems?

I have been reading up on gradient boosting machines, and in particular GBRT's. I've come across numerous mentions (and finally tracked down some papers) on applying these models to ranking problems - ...
0
votes
0answers
6 views

How is the weighted version of Kendall's Tau computed? And is there an implementation in R yet?

I could not find a satisfying answer to my question yet. Could someone maybe give me a very simple numerical example how the weighted version of Kendall's tau is calculated? Maybe for the following ...
2
votes
1answer
18 views

How to select the next matchup to best reduce uncertainty in a ranking

So say I have 30 teams and I want to schedule their games with the objective getting the most information concerning who's better than who as quick as I can. How do I do this. Let's say we have a ...
2
votes
1answer
20 views

Ranking Data Comparison

I'm currently analyzing my experimental data and I have a question about comparing two variables. In the experiment I have a question which asks respondents to rank a set of pictures based on their ...
0
votes
0answers
22 views

How to compare three groups ranking a set of items?

I have six photos which the test subjects rank according to their preference. So the response per person is six columns, "Rank of photo A" to "Rank of photo F". I am grouping the subjects by ...
1
vote
1answer
19 views

Trying do determine how to rank water flow measurements?

I'm doing a study that involves waterflow measurements as it relates to erosion prioritizing. I'd like to rank between (0-1) a population of 160 values with a minimum of 2.1 and a maximum of 5.9 The ...
5
votes
2answers
60 views

Where do the default values in the Elo ratings formulas come from?

After doing some reading about the Elo ratings system, I am trying to implement one. I have some questions on the default values in the formulas. If player A has rating $r_a$ and player b has rating ...
0
votes
0answers
8 views

Ranking data sets by means etc. (unequal sample size and variance)

I want to rank several lists of data by their tendency to be larger or their capacity to be larger when extrapolated. Is there a way to do this effectively?
0
votes
0answers
9 views

How do I treat binary variables when creating a rank for different companies

I am currently doing a project to create a rank for different companies base on numbers of metrics that are available to me. My first thought is to normalize all the numerical variables. I am ...
1
vote
1answer
35 views

How Do I Rank the GPA of Students from Different Colleges?

I have data from 100 students, each at a different college would like to rank them by GPA. I have the following data for each: The student's GPA: example 3.25 The all student average: 3.10 The ...
0
votes
0answers
11 views

best approach to model search ranking for an ecommerce site

I am trying to build a model to rank search results in my ecommerce site. I am ideally trying to rank results that are relevant to the user query and in turn would result in a sale. I have text score ...
4
votes
1answer
41 views

I have 12 items to get into a single rank order. Can I get this from having a few hundred people see a set of 10 of the possible pairs of items?

I attempted to run a study where people had to rank order 12 statements from best to worst. However, it was extremely messy and difficult for people to rank that many items. Now, my professor and I ...
0
votes
0answers
28 views

methods to validate effectiveness of ranking system?

I seek to compare the effects of different rating-based ranking methods and examine which ranking would lead to higher sales (i.e., which is ranking is superior to increase customer conversion rate). ...
0
votes
1answer
17 views

Learning to Rank with no queries

I want to rank (order by relevance) some data, and I currently have some labeled observations (relevance scores given by a user) and some unlabeled observations. I'm currently studying learning to ...
2
votes
1answer
44 views

Can rank variables be iid?

I'm curious about the responses to some questions I've found on this site -- but I can't post comments yet, so I am starting a new question. At least two people have asked about regression to predict ...
1
vote
1answer
43 views

weighting matches by time and variance

I'm putting together a rating system for hockey teams and have data on the number of goals conceded for each team in each game. I would like to come up with a weighting that gives less erratic results ...
0
votes
0answers
4 views

Ranking districts (on basis of % cahnge) after controlling initial conditions

We want to rank Indian districts as good/bad/average performer on the basis of change in access to latrine between 2001 and 2011. We calculate the percentage point change in access to latrine ...
0
votes
0answers
9 views

Score Scaling for ranking problems

I am working on a problem, where I might want to switch out between Model A and Model B both of which are used to make recommendations of the type >. The scores are in descending orders. The output of ...
0
votes
1answer
41 views

Normalization of values

How do I normalize a set of data? Let's say we are looking at measurements of diameter of the heart in women and men. Men will have bigger hearts, so error in measuring by the observers will always be ...
2
votes
1answer
39 views

How to perform ordinal regression with rank-based dependent variable?

I have a dataset I'm about to use for some preliminary testing. However, I've stumbled onto a puzzle which I cannot seem to figure out. ...
1
vote
0answers
27 views

Modeling bias in reviews of conference papers

An article in Science Magazine claims that A little bias in peer review scores can translate into big money, simulation finds . The paper referred to there is paywalled, though. Can anyone point me to ...
1
vote
0answers
42 views

Weighted arithmetic mean's alternative for ranking items

I have a Blog post ranking algorithm which has 5 factors which are considered for calculating final score. I have predefined input range according to which i decide score of a factor. e.g. Factor : ...
1
vote
3answers
22 views

Averaging rankings of small geographical areas to find an average ranking for a larger area

I have a friend who is very intelligent with a professional background in accountancy but no formal mathematical or scientific training. He is studying for a PhD (as a mature student) looking at how ...
0
votes
0answers
18 views

Specifying an HLM model in SPSS (ranking data)

In SPSS, I am receiving the error: The final Hessian matrix is not positive definite although all convergence criteria are satisfied. And when looking at the output, it is telling me that the ...
2
votes
2answers
83 views

Ranking features in logistic regression

I used Logistic Regression. I have six features, I want to know the important features in this classifier that influence the result more than other features. I used Information Gain but it seems that ...
2
votes
2answers
56 views

Models that can rank relative performance among teams?

I'm looking for help towards finding a proper model for the problem I'm facing. I have a data set of teams that face each other and have a binary outcome Win/Lose. I want to establish some sort of ...
0
votes
0answers
10 views

Paired test (non-independent) for rank order data

I have responses from a survey with questions where respondents were asked to rank their top 3 choices from a list of 8 choices. An example of the type of question would be to rank their top 3 methods ...
1
vote
1answer
53 views

Test/Measure for Rank Ordering a Logistic Regression model, invariant to event rate and population size

I have a model whose purpose is to rank order event risk - the output of which is split into twentiles (which have been based off the benchmark data). Currently, I'm using Somers' D calculated on ...
0
votes
0answers
18 views

Adding Factor Scores after PCA to create index

I am creating a single index and have narrowed my variables down to two Components using Principal Components analysis (varimax rotation). I have a ton of literature/theory that states that the two ...
0
votes
0answers
21 views

Mean Rank Order Format

my apologies for my obvious lack of knowledge in the matter, however I am currently doing an assignment in which we had to conduct a mini research study in order to assess our SPSS skills. One of the ...
0
votes
0answers
29 views

Clustering with restrictions

I have this dataset of a ranking of roughly 32.5k players in increasing order. The third column contains the number of players which have the corresponding score, whilst the second is the number ...
0
votes
0answers
35 views

help with computing standard score for scarce discretely quantized data

I'm not a stats major and I'd appreciate any help I can get. I've got data with each point defined by a score (between 0-1) and a frequency (0-100%). At 100%, the score is most reliable, at 1% the ...
0
votes
0answers
14 views

Survey ranked choices bigger population of choices visualization and significance testing

A little bit of background, this is about Magic: the Gathering. Out of a pool of maybe 40 viable Legacy decks, experts were asked to rank the 5 decks they thought were best. This means we don't have ...
1
vote
1answer
50 views

How U.S. News college ranking works

I am interested in the model/algorithm that they use to evaluate college ranking. Any ideas? Regression or simply weighting system
3
votes
2answers
37 views

Creating a rank on performance and size

Ranking is not something that I need to do particularly frequently in my job and its probably the weakest part of my statistics background. I have a dataset containing a list of items and a ...
1
vote
1answer
40 views

What are good resources on Bayesian rating?

I am figuring out how to build a ranking system for movies using IMDB data. My own dataset related exclusively to "art movies", so they would tend to have fewer reviews than the average IMDB movie ...
0
votes
0answers
15 views

Methods for ranking measurements with different confidence

Say I have an experiment running and I collect data for $n$ different settings for some variable $x$ and I collect $n$ different distributions of results, each with a different mean and standard ...
0
votes
0answers
30 views

comparing ranks for a multinomial distribution between sample and population

I have a known multinomial distribution of a population due to a census. I want to compare a sample with this population. I want to know the probability that the same ranking of the classes of the ...
0
votes
0answers
29 views

Normalized strength of schedule ranking system in R

What is the process of creating a pairwise ranking system in R? Specifically looking for the iterative ranking of margin of victory determined by strength of schedule to normalize for opponents ...
0
votes
0answers
12 views

Stats Metric for how dynamic/changing a market is

Note: I am not a stats expert. I have the following hypothetical example: The image below describes the five highest sold car brands (monthly) in 2014 versus in 2015 (only 5 months). In 2014, ...
0
votes
0answers
16 views

Finding the most important variable for a ranking problem?

I am working on a problem which I believe should be standard in statistics but unable to dig more. I have $N$ objects and two variables $x\in [0,1]$ and $y\in [0,100]$ which take different values for ...
0
votes
1answer
35 views

Pairwise Learning to Rank SVM - class labeled 0

Recently, I am doing research about learning to Rank. Basically, we want to find the pattern for the sample as follows, $$S = \{(q_i, d_{ij}), (y_{ij}) \}$$ where $q_i$ denotes the i-th text-based ...
2
votes
0answers
47 views

Is there an algorithm for determining scoring function (Utility function) in ranking instances?

So while going through the topic of Preference learning, I came to know about "instance ranking". Since the problem which I'm working on requires me to rank the instances (data point), is there any ...
1
vote
1answer
43 views

Methodology to rank contributors

I have contributors who complete certain no of tasks in a day. I want to rank them. Below is the data. User 1 has been given 1 task and he completed it = 100% completion User 2 has been given 20 ...
0
votes
0answers
10 views

Can rank ordered mixed logit handle varying set sizes?

I have data that consist of numerous trials, where each trial is a ranked set of items. The set of items for each trial is a subset of varying size of all possible items. (I.e. the items are shared ...
0
votes
0answers
10 views

What test can I apply for ranking score data?

I have collected data from male and female teachers on their preference of reading materials. They were asked to rank their preference by marking numbers 1 to 5. i.e. 1 for the most preferred and 5 ...
0
votes
0answers
22 views

Compare the agreement between two models based on the ranks of outputs

I have wheat area data for 100 locations (all locations have the same size). I want to run 2 different models on these 100 locations for modelling the wheat area. One model gives me output in terms of ...
1
vote
0answers
561 views

Conducting pairwise ranking with XGBoost

I am trying to build a ranking model using xgboost, which seems to work, but am not sure however of how to interpret the predictions. I haven't been able to find relevant documentation or examples on ...
0
votes
0answers
8 views

Model selection for order of ranked data in unequally distributed groups?

I'm wondering what type of analysis or statistical model would work best for this particular type of scenario. I've encountered once before (I'll explain that at the bottom) but the example ...