Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the "valuation" tag, too.

learn more… | top users | synonyms (1)

1
vote
1answer
44 views

Correct way to compare ranking data

First, I have as original data Rank Content 1 A 2 B 3 C 4 D 5 E Then I use my algorithm to prioritize and filter the data: ...
1
vote
0answers
31 views

What is the best way to present rank survey data?

I have a survey data where I've asked a local community to rank 6 different issues they face on a scale of 1 to 6. For example, ...
1
vote
1answer
42 views

Proving similarity between two rankings

We are seeking a comparison of two different rankings of the same 3 systems Background: We have conducted a test of 3 different systems. Participants experienced a system and rated it on a 7-point ...
0
votes
0answers
13 views

Ranking based on weight for multiple variables and objectives

First of all, I know very little about statistics. I need help ranking a set of multiple solutions (about 138 solutions) based on three objectives. I work on the architectural design field, I analyzed ...
0
votes
0answers
13 views

Pairwise Learning to Rank - detecting detrimental changes

The idea behind Pairwise Learning to Rank is that if you have a set of search results then a clicked on result can be used as training example to indicate that it should rank more highly that the ...
0
votes
0answers
16 views

Generate weighted multidimensional index with Likert-data

I am a bit desperate and hope you can help me with my issue. I'm analyzing the attractiveness of several countries. To do so, I asked practitioners to evalute 17 dimensions on a 1-5 (5 best) ...
0
votes
1answer
37 views

What's the best way to convert pair-wise ranking to a ranked list?

I have a set of ordered items A > B > C ... > F. For each element of the set I have a feature vector. Using these features I trained a neural network to predict the probability that A > B for any pair ...
3
votes
1answer
47 views

Rank versus Box-Cox transformation

I'm attempting to assess the relationship between two quantitative variables, but the DV is highly skewed (and so are the residuals). I work among biologists who tend to favor non-parametric ...
0
votes
0answers
30 views

Update (Bayesian?) selection probability based on rankings

I am looking for a framework to help solve a prioritisation/selection problem but am not sure what the technical name for this type of problem would be (knowledgable edits welcome!). Main problem ...
1
vote
0answers
18 views

Analyzing a “ranking” question on a survey

I gave a survey to Volunteers. Now I am not sure how to code a certain question, so I can evaluate. The question is "Please rank what motivates you to....? (1 = most motivating, 2 - 2nd most...). ...
1
vote
0answers
21 views

Assign the tree species most representitive of a specific size class

I am replicating another study in which trees were assigned to a class based on diameter. The most representative species of each class was identified for each plot sampled. The classes are sapling ...
1
vote
0answers
33 views

Find meaningful next comparison for total ranking on the fly

I want to obtain a total ranking from pairwise binary comparisons. For this, I can use algorithms like Balanced Rank Estimation or Bradley-Terry Model. However, I wonder if you need fewer comparisons, ...
1
vote
2answers
55 views

Algorithm and R code for dealing with ties in Wilcoxon rank-sum test

1) I think one of the algorithms used to handle ties for the Wilcoxon rank-sum test (a.k.a. Mann-Whitney U test) is Streitberg / Rohmel. I could not find a good source which explains the algorithm/ ...
1
vote
1answer
23 views

Multiple pairwise comparison DOE

I'm going to conduct experiment with 7 products. One subject can evaluate no more than 3 products. The ultimate goal is to compare all 7 products to each other (let say, on means) and rank them. So, ...
0
votes
0answers
15 views

Ranking search results

I was looking at npm (the largest javascript package manager) and how they implemented the search results ranking. Each package has several important fields: name keywords description ...
0
votes
1answer
19 views

Analyzing multiple, within-subjects, non-independent ordinal rankings

So I'm working with some previously collected data where participants (N=139) were asked to rank 3 types of events (1 being best, 3 being worst) for 6 separate scenarios. The question of interest is ...
0
votes
0answers
15 views

How to weight ranked preferences for items

So it's quite possible that I'm about to ask a very basic question, but here it goes. Consider 4 individuals who are asked to rank 4 items from 1 (most preferred) to 4 (least preferred). The item that ...
0
votes
0answers
8 views

Processing pairwise comparisons

I am designing a perceptual test. I have N stimuli and K features {f1...fK}. During the test, the subject has to compare pairs of stimuli according to each feature. For example, given a pair of ...
2
votes
1answer
32 views

Which metric should I use to rank these distributions?

I have a number of 1D distributions, which, when plotted show a distinct ranking in terms of the "spikiness" of the data. I would like to apply a relatively fast metric that would allow me to rank ...
0
votes
0answers
37 views

How do I visualize participants' rankings of options in order of preference?

I asked people to 'Rank in order which social media platforms you use most', using Google forms. (The ranking $1$ represented the most used.) There were 10 different social media platforms to choose, ...
1
vote
0answers
28 views

How to analyze ranks as responses?

A client has data where multiple subjects (people) have been presented with with four product alternatives, and after experiencing all four, were asked to rank the products. The data look like ...
1
vote
1answer
20 views

comparison of more than two sets of rankings

I have 4 judges who listened to a set of 35 musical auditions. Each judge was then tasked with ranking the auditions from 1-35 in order of performance ability. What test can I use to compare agreement ...
1
vote
0answers
25 views

Differences between a 100 point grading scale, 10 point grading scale and a 5 point grading scale?

If I am ranking a set of items based on their performance on a set of categories (each of which has a different importance, or weight, in the total score). What are the pros and cons of a 100 point ...
0
votes
0answers
11 views

How to adjust rank for ad for its recent trend in click-through-rate?

I am building an optimization service for an Adtech company. For ranking ads in terms of performance, I am using formula: Log(impressions)*eCPM. Impressions means the number of times ad was ...
1
vote
0answers
29 views

ranking based of number of items and value

How to avoid the issue of an item with a single 5-star rating getting a higher average rating than one with (99 5-star ratings and one 4-star rating). How to properly rank based on average star and ...
1
vote
1answer
136 views

Analyzing Ranked Data: Correlation and Factor Analysis?

I had survey respondents rank a series of items in order of importance, from 1 to 7. So, if a respondent assigned a score of 1 to one variable, then none of the other variables could get a 1 as well. ...
3
votes
1answer
62 views

Ranking batters by average when number of observations (innings) vary

This is my first post here and I'm new to this area so please forgive me if I'm asking a naive question. I want to rank a number of batsmen (e.g., in cricket) by their skill. I'm planning to use ...
0
votes
0answers
8 views

How to combine probabilities for (partial) set ordering?

Say you have a situation where you can measure related values for a number of parameters (say A, B, C & D) and thus order those values (e.g. A>B>C>D or D>B>A>C). You have a population of ...
0
votes
2answers
145 views

TF-IDF versus Cosine Similarity in Document Search

I'm wondering if anyone can help me out or point out some resources to learn more about TF-IDF and document search. I'm trying to implement a basic document search and am trying to better understand ...
0
votes
0answers
10 views

Calculating parameters for a custom ranking algorithm with no training data

On my site, we want to be able to sort search results for books by hot they are. When a book is added to the site its hotness is set to number of hours since the epoch, purchases, reviews and ...
0
votes
0answers
3 views

Determining utility from force-ranked responses

I am a product manager at a software company. We are thinking about offering a new reporting feature. There are about 15 different columns that we could display, each providing descriptive statistics ...
1
vote
1answer
42 views

How to rank rankings? Two factors - freq and rank but freq has to has much more weight

My respondents has to evaluate number of items (say, 20). Formerly they had to just check three that they liked (like/dislike) and I simply counted the most checked. I 'improved' survey by replacing ...
0
votes
0answers
32 views

Averaging Rank Sum Weights and Rank Order Centroid

I have calculated Weights of fourteen items using Rank Order Centroid, Rank Sum Method. ...
0
votes
0answers
22 views

Multi-Competitor Rankings Applied to a Sport

I have data of the form: competition ID | player ID | score What I want is a function that would absoluteHistoricalScoreOfPlayer(all historical scores). What I possibly might need is a Plackett-Luce ...
0
votes
0answers
16 views

Extracting latent factor from ranking data

I want to construct a model to link between a set of quantitative engineering parameters (e.g. Sm, Ra) of 9 material samples to a set subjective qualitative rankings of 6 perceived attributes, e.g. ...
0
votes
0answers
63 views

How to tune parameters of SVM Rank?

I am using SVM Rank, which has multiple parameters, changing whom I am getting a variety of results. Is there some mechanism to tune and get the best parameters? Below are the different parameters: ...
0
votes
0answers
38 views

Confidence intervals for median from Wilcoxon signed rank statistic

We are given the sample $X_1, ..., X_n$ from a common distribution with median $\mu$. Using Wilcoxon's signed rank statistic, how can I construct a confidence interval in terms of the order statistics ...
0
votes
0answers
49 views

Scoring model/formula to rank based on accuracy of data sources

Let us say i have 5 different data sources. My aim is arrive a score to arrive the accuracy of this data sources. It is like below 1. Refer the section Data confidence calculation in ...
0
votes
0answers
104 views

How to do ranking with scikit-learn random forest model

I have a training dataset that I've developed, that has the following format: ------------------------------ | User ID | Item | Label | ------------------------------ | 001 | umbrella | 0 ...
0
votes
0answers
33 views

What algorithm can give me a probability-ranking on text-classifaction problems

I'm trying to classify e-mails using tokens in the text and headers. What I would like to know is which class a new e-mail most likely belongs to. The answer could be more than one class or could ...
0
votes
2answers
40 views

Can I use SVM classification probability for ranking?

I have used SVM for finding relevant results, denoting relevant results by class 1 and irrelevant results as class 0. SVM gives a probability of the label assigned. Can I rank the results of class 1, ...
1
vote
0answers
14 views

Ranked responses across survey questions

We have a set of arthritis disease activity questions. Patients are given a scenario that describes a disease activity level scenario, like (A)"It is not painful to write" or (B)"It is painful to ...
0
votes
0answers
38 views

How to sort some variables based on their importance?

I have very little knowledge of statistics so please point me in the right direction if this question has already been answered. I tried searching but don’t know the correct keywords to search for. I ...
1
vote
2answers
22 views

Ranking estimation with partial data

Consider a problem where we ask a number of people to select and rank their top three choices out of a number of options. The set of options is the same for everyone, and they all have to rank their ...
2
votes
1answer
58 views

How to find similar users by looking at their votes in a community website?

I run a community website with ~1600 users who made 750 000 votes on 100 000 posts. The votes are made on the Likert scale, i.e. from 1 to 5. I want to help users find like-minded people. After some ...
-1
votes
1answer
58 views

How do I rank companies? [duplicate]

I have some information against each company we deal with. For e.g. number of employees, business volume, average salary, etc. Which technique can I use to rank each company against the others? ...
0
votes
1answer
18 views

Ranking performance measure

I have a system able to produce a ranking of some operations according to their anomalous score. I have N anomalous operations inside the dataset, which I expect to be in the first N positions (best ...
0
votes
0answers
20 views

Measure the Ranking of Variables

What I want to do is compare the ordering of variables determined by the ranking of each variable. For example: Say, I have a rating system that is made up of 5 different ratings - Excellent Good ...
2
votes
0answers
30 views

Which stats model to predict rank when participants arrange conditions by rank?

Just a quick clarification: This question is about when participants specify which condition is most X, second most X, third most X, etc. It's not about the researcher converting continuous DV's into ...
0
votes
0answers
17 views

Confidence in a rank ordering (Fez)

The beautiful indie game Fez has numerous puzzles and centers around cryptic messages that are read to you in an "alien language". At one point, you can enter a village, where all the villagers speak ...