Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

learn more… | top users | synonyms (1)

0
votes
0answers
3 views

selecting most similar ordering over many groups

Suppose we have many product categories with 2-4 products in each. Products within each category is ranked according to quality. This 'true' ranking is known, but the goal is to select a model out of ...
4
votes
1answer
54 views

Rank and z-transform instead of Wilcoxon?

Andrew Gelman in a recent post in his blog suggests using a rank, transforming the rank to a z-score, and then using parametric tests and tools instead of performing non-parametric tests. I never ...
0
votes
0answers
8 views

How to determine central ranking in Mallows' model?

I've been trying to read up on Mallows' model, which involves ranked (full, or partial) data. One of the parameters is the central ranking. However, the resources that I have read online do not tell ...
1
vote
1answer
18 views

Is there a three-way or five-way version of Wilson Score?

Wilson Score can be used in online rating systems, but it is based on a binomial distribution which, according to Wikipedia's Binomial proportion confidence interval, is when there are only two ...
0
votes
0answers
5 views

Normalising Ranking Data with Conflict of interest

Imagine a small survey where 3 reviewers are asked to rank three applicants 1 being best, three being worst. Reviewer 3 has a conflict of interest for applicant 3 so decides not to rank them. They ...
0
votes
1answer
48 views

Which ones of $n$ random variables have the largest mean (non-parametric way)?

Let us have $n$ random, mutually independent variables $X_1,X_2,\dots,X_n$. Let us have some samples of them such as $x_{i,j}$ where $i=1,\dots,n$. I want to know the maximal variable(s) based on ...
0
votes
0answers
13 views

Metrics for evaluating ranking algorithms

I'm interested in looking at several different metrics for ranking algorithms - there are a few listed on the Learning to Rank wikipedia page, including: • Mean average precision (MAP); • DCG and ...
0
votes
0answers
11 views

How do I calculate rank based on survey response?

I have done a survey that rank species on some criteria. Number of species per respondent may vary. Out of all listed species by a respondent, I ask them to rank (1 = highest). The lowest depends on ...
0
votes
1answer
19 views

Ranking means and standard deviations

I have the following data from a survey: Group 1 has a Mean of 3.97 and Standard Deviation of 1.569; Group 2 has a Mean of 3.72 and Standard Deviation of 1.514; Group 3 has a Mean of 4.31 and ...
2
votes
1answer
16 views

weight a rating system to favour more severe cases

I have a rating system which can take 5 possible outcomes, which are coded to: ...
0
votes
0answers
18 views

Reconstructing individual rankings from popularity scores

I have the scores from lots of voters voting top N choices from >100 choices, and I want to reconstruct the rankings of all voters based on this distribution, to predict the coming results. What ...
0
votes
0answers
28 views

Ranking the performance of countries (entities) from a panel-based fixed effects regression

I am performing a fixed effects regression analysis on countries, $i$, over a time period $t$ with regressor $X$ and outcome $y$ so that the equation is $y = \beta_0 + \beta_1 X_{it} + \epsilon_{it}$ ...
1
vote
0answers
10 views

Testing if two rankings are equivalent

I have some process A that assigns values y_i for i=1:N to instances x_i. ...
0
votes
1answer
22 views

Algorithm to rank some items

Say I have some items with values 3.3 3.4 6.2 8.8 4.1 and I want to rank them as follow ...
0
votes
0answers
37 views

Combining multiple metrics to provide comparisons/ranking of k objects [Question and Reference Request]

Collecting $n$ metrics about $k$ objects Suppose I collect $n$ metrics about $k$ objects. I am looking into valid ways to compare the $k$ objects so they can be "ranked". I think this may be ...
1
vote
1answer
46 views

Correct way to compare ranking data

First, I have as original data Rank Content 1 A 2 B 3 C 4 D 5 E Then I use my algorithm to prioritize and filter the data: ...
2
votes
0answers
79 views

What is the best way to present rank survey data?

I have a survey data where I've asked a local community to rank 6 different issues they face on a scale of 1 to 6. For example, ...
1
vote
1answer
56 views

Proving similarity between two rankings

We are seeking a comparison of two different rankings of the same 3 systems Background: We have conducted a test of 3 different systems. Participants experienced a system and rated it on a 7-point ...
0
votes
0answers
45 views

Ranking based on weight for multiple variables and objectives

First of all, I know very little about statistics. I need help ranking a set of multiple solutions (about 138 solutions) based on three objectives. I work on the architectural design field, I analyzed ...
0
votes
0answers
17 views

Pairwise Learning to Rank - detecting detrimental changes

The idea behind Pairwise Learning to Rank is that if you have a set of search results then a clicked on result can be used as training example to indicate that it should rank more highly that the ...
0
votes
0answers
30 views

Generate weighted multidimensional index with Likert-data

I am a bit desperate and hope you can help me with my issue. I'm analyzing the attractiveness of several countries. To do so, I asked practitioners to evalute 17 dimensions on a 1-5 (5 best) ...
0
votes
1answer
59 views

What's the best way to convert pair-wise ranking to a ranked list?

I have a set of ordered items A > B > C ... > F. For each element of the set I have a feature vector. Using these features I trained a neural network to predict the probability that A > B for any pair ...
3
votes
1answer
69 views

Rank versus Box-Cox transformation

I'm attempting to assess the relationship between two quantitative variables, but the DV is highly skewed (and so are the residuals). I work among biologists who tend to favor non-parametric ...
0
votes
0answers
33 views

Update (Bayesian?) selection probability based on rankings

I am looking for a framework to help solve a prioritisation/selection problem but am not sure what the technical name for this type of problem would be (knowledgable edits welcome!). Main problem ...
1
vote
0answers
29 views

Analyzing a “ranking” question on a survey

I gave a survey to Volunteers. Now I am not sure how to code a certain question, so I can evaluate. The question is "Please rank what motivates you to....? (1 = most motivating, 2 - 2nd most...). ...
1
vote
0answers
22 views

Assign the tree species most representitive of a specific size class

I am replicating another study in which trees were assigned to a class based on diameter. The most representative species of each class was identified for each plot sampled. The classes are sapling ...
1
vote
0answers
36 views

Find meaningful next comparison for total ranking on the fly

I want to obtain a total ranking from pairwise binary comparisons. For this, I can use algorithms like Balanced Rank Estimation or Bradley-Terry Model. However, I wonder if you need fewer comparisons, ...
1
vote
2answers
91 views

Algorithm and R code for dealing with ties in Wilcoxon rank-sum test

1) I think one of the algorithms used to handle ties for the Wilcoxon rank-sum test (a.k.a. Mann-Whitney U test) is Streitberg / Rohmel. I could not find a good source which explains the algorithm/ ...
1
vote
1answer
29 views

Multiple pairwise comparison DOE

I'm going to conduct experiment with 7 products. One subject can evaluate no more than 3 products. The ultimate goal is to compare all 7 products to each other (let say, on means) and rank them. So, ...
0
votes
0answers
23 views

Ranking search results

I was looking at npm (the largest javascript package manager) and how they implemented the search results ranking. Each package has several important fields: name keywords description ...
0
votes
1answer
34 views

Analyzing multiple, within-subjects, non-independent ordinal rankings

So I'm working with some previously collected data where participants (N=139) were asked to rank 3 types of events (1 being best, 3 being worst) for 6 separate scenarios. The question of interest is ...
0
votes
0answers
21 views

How to weight ranked preferences for items

So it's quite possible that I'm about to ask a very basic question, but here it goes. Consider 4 individuals who are asked to rank 4 items from 1 (most preferred) to 4 (least preferred). The item that ...
0
votes
0answers
10 views

Processing pairwise comparisons

I am designing a perceptual test. I have N stimuli and K features {f1...fK}. During the test, the subject has to compare pairs of stimuli according to each feature. For example, given a pair of ...
2
votes
1answer
38 views

Which metric should I use to rank these distributions?

I have a number of 1D distributions, which, when plotted show a distinct ranking in terms of the "spikiness" of the data. I would like to apply a relatively fast metric that would allow me to rank ...
0
votes
0answers
68 views

How do I visualize participants' rankings of options in order of preference?

I asked people to 'Rank in order which social media platforms you use most', using Google forms. (The ranking $1$ represented the most used.) There were 10 different social media platforms to choose, ...
1
vote
0answers
36 views

How to analyze ranks as responses?

A client has data where multiple subjects (people) have been presented with with four product alternatives, and after experiencing all four, were asked to rank the products. The data look like ...
1
vote
1answer
26 views

comparison of more than two sets of rankings

I have 4 judges who listened to a set of 35 musical auditions. Each judge was then tasked with ranking the auditions from 1-35 in order of performance ability. What test can I use to compare agreement ...
1
vote
0answers
40 views

Differences between a 100 point grading scale, 10 point grading scale and a 5 point grading scale?

If I am ranking a set of items based on their performance on a set of categories (each of which has a different importance, or weight, in the total score). What are the pros and cons of a 100 point ...
0
votes
0answers
15 views

How to adjust rank for ad for its recent trend in click-through-rate?

I am building an optimization service for an Adtech company. For ranking ads in terms of performance, I am using formula: Log(impressions)*eCPM. Impressions means the number of times ad was ...
1
vote
0answers
37 views

ranking based of number of items and value

How to avoid the issue of an item with a single 5-star rating getting a higher average rating than one with (99 5-star ratings and one 4-star rating). How to properly rank based on average star and ...
1
vote
1answer
259 views

Analyzing Ranked Data: Correlation and Factor Analysis?

I had survey respondents rank a series of items in order of importance, from 1 to 7. So, if a respondent assigned a score of 1 to one variable, then none of the other variables could get a 1 as well. ...
3
votes
1answer
78 views

Ranking batters by average when number of observations (innings) vary

This is my first post here and I'm new to this area so please forgive me if I'm asking a naive question. I want to rank a number of batsmen (e.g., in cricket) by their skill. I'm planning to use ...
0
votes
0answers
10 views

How to combine probabilities for (partial) set ordering?

Say you have a situation where you can measure related values for a number of parameters (say A, B, C & D) and thus order those values (e.g. A>B>C>D or D>B>A>C). You have a population of ...
0
votes
2answers
416 views

TF-IDF versus Cosine Similarity in Document Search

I'm wondering if anyone can help me out or point out some resources to learn more about TF-IDF and document search. I'm trying to implement a basic document search and am trying to better understand ...
0
votes
0answers
13 views

Calculating parameters for a custom ranking algorithm with no training data

On my site, we want to be able to sort search results for books by hot they are. When a book is added to the site its hotness is set to number of hours since the epoch, purchases, reviews and ...
0
votes
0answers
6 views

Determining utility from force-ranked responses

I am a product manager at a software company. We are thinking about offering a new reporting feature. There are about 15 different columns that we could display, each providing descriptive statistics ...
1
vote
1answer
48 views

How to rank rankings? Two factors - freq and rank but freq has to has much more weight

My respondents has to evaluate number of items (say, 20). Formerly they had to just check three that they liked (like/dislike) and I simply counted the most checked. I 'improved' survey by replacing ...
0
votes
0answers
48 views

Averaging Rank Sum Weights and Rank Order Centroid

I have calculated Weights of fourteen items using Rank Order Centroid, Rank Sum Method. ...
0
votes
0answers
29 views

Multi-Competitor Rankings Applied to a Sport

I have data of the form: competition ID | player ID | score What I want is a function that would absoluteHistoricalScoreOfPlayer(all historical scores). What I possibly might need is a Plackett-Luce ...
0
votes
0answers
17 views

Extracting latent factor from ranking data

I want to construct a model to link between a set of quantitative engineering parameters (e.g. Sm, Ra) of 9 material samples to a set subjective qualitative rankings of 6 perceived attributes, e.g. ...