Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

learn more… | top users | synonyms (1)

0
votes
0answers
22 views

Observation dependency in logistic regression to learn relevance of search results

I want to predict the most relevant item from a set of search results resulting from a query. Moreover, these items are places; the query is at a lat/long and time; and the search results are ...
1
vote
0answers
20 views

How many « degrees of freedom » should a Wilcoxon rank-sum test have?

I would like to perform a Mann-Whitney U Test (also called Wilcoxon rank-sum test) on a weighted sample in R. Such a non-parametric test is required, as neither of the two variables used follow normal ...
0
votes
0answers
10 views

Is using pairwise comparison instead of single label value a valid way to augment training data

There are many papers using siamese architecture to do pairwise ranking. For example: suppose my training set is $\{X,Y\}$, where $Y$ is the continuous value. I can find a regressor to minimize $\|h(X)...
1
vote
1answer
35 views

Determining proper K value for ELO rating

For the question I previously posted here with a general question about elo ranking applied to a a bit weird sport. From the ranking POV it's a bit like marathon - you can have up to n players but - ...
0
votes
0answers
12 views

Cosine distance between two vectors containing positive as well as negative elements

I have two vectors whose elements $\in \mathbb{R}$. Everywhere I have seen the usual definition of cosine similarity and the distance = 1 - similarity. However, on ...
0
votes
1answer
16 views

How to calculate rank from multiple parameters to get best/trustworthy peer

How to calculate rank from multiple parameters ? Parameters are bandwidth ,dealy ,suucess ratio ,these parameters values are used to determine the trustworthiness of a peer while accessing a service ...
1
vote
0answers
19 views

Spearman rho statistical significance value (z)

How can I calculate the statistical significance (Z) of spearman's footrule rho? I came across the formula at this wiki page ...
0
votes
2answers
36 views

Kendall tau: Kendall Score

Currently, I am working with with Kendall tau distance between two rankings. I get a tau value of 0.849, ...
1
vote
0answers
43 views

Appropriate statistical method for rank ordered/preference data where response on one variable depends on the other

I have a dataset of six variables that represent respondents' ranking to six different stimuli. Each respondent ranked this stimuli in order of preference from 1 to 6. This means that each row of a ...
1
vote
1answer
50 views

Distance between rankings - Kendall tau

I want to use Kendall in order to measure the distance between rankings A and B. How do we deal with different ranges? For example, as shown below: let's say we have the following rankings A and B - ...
0
votes
1answer
35 views

Should I normalize or standardize for the particular case?

I was suddenly bombarded with a new topic at the end of my dissertation which other student was supposed to do and its related to statistics which was not my field till now but I am reluctantly ...
0
votes
0answers
23 views

Survey data with ranking measurement error

I run a survey. The participant should rank 10 items with weight 1..10. Unfortunately I did not emphasis enough that every weight can be used once. Now I have a mixed dataset. Some items are ranked 1....
0
votes
1answer
14 views

Alternatives to Google's weighted sort for binomial experiments with n=1

An interesting data scientist interview question: "We are looking at the failure rate for opening files on websites for many clients. We want to rank the files by failure rate; but, with our current ...
1
vote
1answer
21 views

Regression Using Surveys with Unequal Number of Responses

I am trying to figure out how to properly do regression analysis on a data set from a peer-review survey where individuals in the survey have an unequal number of responses. Below is description of my ...
2
votes
2answers
17 views

Ranking tests results with a variable number of questions answered

We want to rank the people based on their scores and number of questions answered. They get one question daily and a running test score based on the number of correct answers vs. the number of ...
0
votes
1answer
36 views

Which proportions are particularly high or low - compare confidence intervals, or logistic regression?

I have a large database of binary decisions (accept or reject), broken down by state of the applicant, so that for each state I can calculate a proportion of positive decisions. e.g. ...
0
votes
2answers
85 views

How to indicate whether the improvement of a ranking is statistically significant over another one in R?

I have two ranked lists of documents (List1, List2). After comparing each of them against the ground truth, I calculate precision at 5 (P@5) metric to measure how good are each of the ranked lists. ...
3
votes
1answer
31 views

How can I make Elo ranking system more diversified?

As far as I know, Elo ranking system generates points between 100-2800 generally. However lets say we have 1,000,000 players. Now this range of points is too small. Many players would get the same ...
0
votes
1answer
33 views

Rank Ordering: Is this a valid method to score different results?

I have a system for handicapping horseraces. I take a given horserace and rank-order the horses in different factors, or categories (I look at things like speed, odds, etc). Say there are 5 horses ...
0
votes
0answers
22 views

Ranking of the prediction

I am currently using random forest to predict fraud on contracts. Each day, we predict the contract of the past day. The problem is, the guys I am working with keep telling that the value we should ...
0
votes
0answers
4 views

Algorithm for ranking population elements based on occurrences and sample ranks

I have a finite pool (population) of about 10000 elements. Samples of 100 elements are randomly chosen, and each sample is then ranked based on random element attributes. The 100 elements are then ...
5
votes
1answer
44 views

Are parametric tests on rank transformed data equivalent to non-parametric test on raw data?

Many non-parametric tests are identical to their parametric equivalent on ranked data. At least, that's what I learned from this blog post on Friedman's test and skimming this 1981 article.. This ...
0
votes
0answers
10 views

Methods for Developing Weights in Indexes

Example: I am building a macroeconomic index using >10 variables, and these variables, taken together, will numerically rank best and worst countries. What statistical methods/procedures would you ...
0
votes
0answers
7 views

Finding coefficients for cumulative ranked scores based on training set

I have a list of 20,000 items, ranked based on cumulative score Z with four parameters as follows: Z = A + B + C + D I also have a panel ("training set") of 100 items which I know should be ranked ...
1
vote
1answer
50 views

Why are gradient boosting regression trees good candidates for ranking problems?

I have been reading up on gradient boosting machines, and in particular GBRT's. I've come across numerous mentions (and finally tracked down some papers) on applying these models to ranking problems - ...
0
votes
0answers
14 views

How is the weighted version of Kendall's Tau computed? And is there an implementation in R yet?

I could not find a satisfying answer to my question yet. Could someone maybe give me a very simple numerical example how the weighted version of Kendall's tau is calculated? Maybe for the following ...
2
votes
1answer
28 views

How to select the next matchup to best reduce uncertainty in a ranking

So say I have 30 teams and I want to schedule their games with the objective getting the most information concerning who's better than who as quick as I can. How do I do this. Let's say we have a ...
2
votes
1answer
36 views

Ranking Data Comparison

I'm currently analyzing my experimental data and I have a question about comparing two variables. In the experiment I have a question which asks respondents to rank a set of pictures based on their ...
0
votes
0answers
26 views

How to compare three groups ranking a set of items?

I have six photos which the test subjects rank according to their preference. So the response per person is six columns, "Rank of photo A" to "Rank of photo F". I am grouping the subjects by religion,...
1
vote
1answer
21 views

Trying do determine how to rank water flow measurements?

I'm doing a study that involves waterflow measurements as it relates to erosion prioritizing. I'd like to rank between (0-1) a population of 160 values with a minimum of 2.1 and a maximum of 5.9 The ...
5
votes
2answers
70 views

Where do the default values in the Elo ratings formulas come from?

After doing some reading about the Elo ratings system, I am trying to implement one. I have some questions on the default values in the formulas. If player A has rating $r_a$ and player b has rating $...
0
votes
0answers
9 views

Ranking data sets by means etc. (unequal sample size and variance)

I want to rank several lists of data by their tendency to be larger or their capacity to be larger when extrapolated. Is there a way to do this effectively?
0
votes
0answers
11 views

How do I treat binary variables when creating a rank for different companies

I am currently doing a project to create a rank for different companies base on numbers of metrics that are available to me. My first thought is to normalize all the numerical variables. I am ...
1
vote
1answer
41 views

How Do I Rank the GPA of Students from Different Colleges?

I have data from 100 students, each at a different college would like to rank them by GPA. I have the following data for each: The student's GPA: example 3.25 The all student average: 3.10 The ...
0
votes
0answers
14 views

best approach to model search ranking for an ecommerce site

I am trying to build a model to rank search results in my ecommerce site. I am ideally trying to rank results that are relevant to the user query and in turn would result in a sale. I have text score (...
4
votes
1answer
48 views

I have 12 items to get into a single rank order. Can I get this from having a few hundred people see a set of 10 of the possible pairs of items?

I attempted to run a study where people had to rank order 12 statements from best to worst. However, it was extremely messy and difficult for people to rank that many items. Now, my professor and I ...
0
votes
0answers
37 views

methods to validate effectiveness of ranking system?

I seek to compare the effects of different rating-based ranking methods and examine which ranking would lead to higher sales (i.e., which is ranking is superior to increase customer conversion rate). ...
0
votes
1answer
27 views

Learning to Rank with no queries

I want to rank (order by relevance) some data, and I currently have some labeled observations (relevance scores given by a user) and some unlabeled observations. I'm currently studying learning to ...
2
votes
1answer
46 views

Can rank variables be iid?

I'm curious about the responses to some questions I've found on this site -- but I can't post comments yet, so I am starting a new question. At least two people have asked about regression to predict ...
1
vote
1answer
45 views

weighting matches by time and variance

I'm putting together a rating system for hockey teams and have data on the number of goals conceded for each team in each game. I would like to come up with a weighting that gives less erratic results ...
0
votes
0answers
5 views

Ranking districts (on basis of % cahnge) after controlling initial conditions

We want to rank Indian districts as good/bad/average performer on the basis of change in access to latrine between 2001 and 2011. We calculate the percentage point change in access to latrine ...
0
votes
0answers
12 views

Score Scaling for ranking problems

I am working on a problem, where I might want to switch out between Model A and Model B both of which are used to make recommendations of the type >. The scores are in descending orders. The output of ...
0
votes
1answer
54 views

Normalization of values

How do I normalize a set of data? Let's say we are looking at measurements of diameter of the heart in women and men. Men will have bigger hearts, so error in measuring by the observers will always be ...
2
votes
1answer
50 views

How to perform ordinal regression with rank-based dependent variable?

I have a dataset I'm about to use for some preliminary testing. However, I've stumbled onto a puzzle which I cannot seem to figure out. https://drive.google.com/file/d/0BzfbOrk7Ans7UGdEbzZtR2NqT0k/...
1
vote
0answers
28 views

Modeling bias in reviews of conference papers

An article in Science Magazine claims that A little bias in peer review scores can translate into big money, simulation finds . The paper referred to there is paywalled, though. Can anyone point me to ...
1
vote
0answers
47 views

Weighted arithmetic mean's alternative for ranking items

I have a Blog post ranking algorithm which has 5 factors which are considered for calculating final score. I have predefined input range according to which i decide score of a factor. e.g. Factor : ...
1
vote
3answers
23 views

Averaging rankings of small geographical areas to find an average ranking for a larger area

I have a friend who is very intelligent with a professional background in accountancy but no formal mathematical or scientific training. He is studying for a PhD (as a mature student) looking at how ...
0
votes
0answers
18 views

Specifying an HLM model in SPSS (ranking data)

In SPSS, I am receiving the error: The final Hessian matrix is not positive definite although all convergence criteria are satisfied. And when looking at the output, it is telling me that the ...
2
votes
2answers
119 views

Ranking features in logistic regression

I used Logistic Regression. I have six features, I want to know the important features in this classifier that influence the result more than other features. I used Information Gain but it seems that ...
3
votes
2answers
64 views

Models that can rank relative performance among teams?

I'm looking for help towards finding a proper model for the problem I'm facing. I have a data set of teams that face each other and have a binary outcome Win/Lose. I want to establish some sort of ...