Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ranking]

Ranking is ordering data from highest to lowest or *vice versa.* For questions about *constructing* scores to use in ranking, please use the [rating] tag, too.

1
vote
0answers
28 views

How to derive a ranking function by analysing feature correlations

I am analysing some employee details to find the efficiency of the employees. Ideally I want some rankings to rank them based on these features. My features include; current salary projects ...
1
vote
2answers
60 views

How to interpret / metric Lasso regression coefficients

Edited Question, since it was a duplicate I used Matlab to make a lasso model for my data that has 41 predictors and 1 response variable, and perhaps I used more variables that I need too or maybe ...
0
votes
0answers
9 views

ranking unrelated items

I am trying to rank some related/unrelated items and asking for your help in the identification of a solution. Let assume that we ask a person whether he likes fruits and vegetables, and he replied ...
0
votes
0answers
12 views

How to penalize for empty fields in DataFrame?

I have to calculate the consistency of racing car drivers during the whole season. My DataFrame consists of 10 columns (10 circuit names) and for each of those columns I have the standard deviation in ...
1
vote
0answers
9 views

Statistical methods for assigning weights based on rank differences?

I have encountered methodological problem in my pursuit of my master's degree, and I hope you can help! I know exactly what I want to do, but I do not know which statistical area this is related to. I ...
0
votes
0answers
5 views

How to evaluate the performance of ranking methods of items with binary and multiple labels?

I hope that you're all fine. I have two different datasets: Dataset 1 has 10 samples: 4 labelled as 'positive' and 6 as 'negative'. Dataset 2 has 10 samples: 3 labelled as 'high', 4 labelled as '...
0
votes
1answer
16 views

convert ranking to points value

I am trying to take several 'ranking' lists add weighted values and come up with a net score to compare. Take the PGA tour players. I would like to take putting, driving and chipping and convert rank ...
0
votes
0answers
33 views

Ranking based on 2 measures

Please help me what method should I used to find the best performing schools as some schools have nearly 1000 students attended exam where as for some schools nearly 100 students attended. How can I ...
2
votes
0answers
9 views

Ranking Metric for 3 elements [Not in the information retrieval sense]

I'm working on a problem which requires me to rank 3 products based on the preferences (i.e. how much a user likes them). Let's say products are A, B, and C I have the ground truth: A > B > C i.e. ...
1
vote
0answers
29 views

Rank non-normally distributed sets of integers: long read sequencing and phase blocks

I have about 20 arrays of empirical integer values, which are each not normally distributed, with long tails. I am looking for a 'sane and sound' metric on how to sort these distributions, "with ...
1
vote
0answers
16 views

interpreting rank difference trend

I am doing some research utilizing popularity ranks in periodic data. I've been able to model the rank data using Zipf Law effectively. I am interested in understanding how the rank changes, as well. ...
0
votes
0answers
6 views

Multilevel generalized linear model (MGLM) with rank dependant variable : Specification issues

I am currently trying to estimate a multilevel generalized linear model (MGLM) on rank data using clmm function from "ordinal" R package. My dependant variable is a ranking variable repeatidly ...
3
votes
0answers
20 views

Comparing a predicted order of events to actual order of events

Sorry about my somewhat limited knowledge of statistics, it's just this is a tad too complex for my knowledge of the subject. I'm running a competition where entrants are told what events happen, and ...
1
vote
2answers
42 views

Developing a simple scoring system for client performance

I was hoping someone can point me in the right direction to develop a simple scoring system or algorithm on clients revenue performance over a period of time. I have over 400 clients with their ...
1
vote
0answers
15 views

What is the best method to rank elements with multiple attributes

This is Kumar, the fire beast monk. The left numbers are the base stats, the green numbers are the stats provided by the equip runes. Depending on your runes you can make your monster more stronger. ...
0
votes
0answers
11 views

Theoretically is it better to sample with or without replacement to approximate a rank test?

Let's say we want to do a rank test since we do not know the exact distribution. Say we have 3 different sample sizes. Which of the following tests (exact permutation, sample with replacement, sample ...
0
votes
0answers
9 views

% variation on 1/x function

My data (X) is the rank position of units sales (y). Eg. x=1 top seller, x=1000 is the 1000th top seller I know that sales number can be estimated by: units(x) = $N_0x^{(-0.5)}$ Now I would ...
1
vote
0answers
38 views

What statistical tools are available to remove bias from a dataset?

Three managers report to me. They have done appraisal of staff under them giving them a percentage. I have to sign-off those ratings but I face two major issues: The managers have a certain way of ...
1
vote
0answers
25 views

Ranking on a 3 point scale

Apologies in advance, my background is in CS rather than statistics, so I may use some terms improperly. I have a data set of a few thousand items scored on a 3 point scale, which my research ...
0
votes
0answers
33 views

Correlation of two values with opposite rank/rating

Consider the following set: ...
2
votes
1answer
29 views

Which metric to use in an ordering problem? auPR / ROC / Lift?

I need to order Users from most likely to perform a binary action X in the next n days, to ...
0
votes
0answers
6 views

Understanding percentile computation [duplicate]

I understand percentile in the context of test scores with many examples (eg. you SAT score falls in the 99th percentile), but I am not sure I understand percentile in the following context and what ...
0
votes
0answers
37 views

Statistical test on likert and ranking data

I have data in which survey participants hand to rank (Rank 1 to 3) three specific products. They also answered some 5 point Likert scale questions (from 1: “Strongly Agree” to 5:“Strongly disagree”) ...
0
votes
0answers
43 views

Weighted Empirical Cumulative Distribution Function (CFD): order values before or after weighting? [before]

My input data are some observations of a continuous variable, let's say the number of kilometers of motorbikes. I did a survey and I collected some observations. Somehow, I computed weights for all ...
0
votes
0answers
30 views

LAMBDAMART model gives low training score for queries having large number of candidate documents

I am using LAMBDAMART as the learning to rank algorithm to rank relevant documents for a given query.The model performs well for the queries having lower number(300-400) of candidate documents.However ...
0
votes
0answers
15 views

From unsupervised clustering to a weighted average?

I am in the process of writing my master's thesis, and have stumbled (as one often do..) upon an area of statistics that I am not familiar with. My setup is, that I initially have 2 features which I ...
0
votes
0answers
38 views

Sorting By User Ratings - Overlapping Wilson Confidence Intervals

I'm working on a personal project to rank user ratings on a 5 star scale and have implemented Evan Miller's often-referenced Wilson Score Interval calculation with the help of this comment. My data ...
0
votes
1answer
19 views

testing whether categorical distributions differ

i have data on how a large population (N ~ 1e8) is distributed into (many) categories (i.e. i have count of instances in each category). some categories have low ...
0
votes
0answers
7 views

Ordered aggregated choices given users preferences

I have an issue creating an ordered list by preferences. Let's say I have 3 users (u1, u2, u3) and 10 topics (t1,...,t10). Each ...
1
vote
0answers
26 views

Help analyzing data ranked on a scale

So, I thought it would be interesting to try an experiment with my family. I baked 13 different kinds cookies this year, and then told my 8 family members to rank from each cookie from 1-13. Is there ...
1
vote
0answers
14 views

how do I determine a ranking from votes by multiple members of a group

I'm having 8 members of a group choose their favorite 12 items from a list in order from 1 to 12. How do I analyze their data and determine the group items' ranking from 1 to 12 ? 1 is most favorite ...
0
votes
0answers
40 views

Analyze Ranking Data

I've some data from an experiment. Users had to use 4 different applications and had to rank these 4 applications in regards to "best overall", "easiest to use", "safest to use" using 1 for the best ...
1
vote
0answers
27 views

Why does rank correlation only depend on copula, and not on the margins, if the margins are continuous

I read that for continuous margins, then Rank correlation only depend on copula and not on the margins. However, it is not the case for the non-continuous margins. Is that because the Kendall's tau (...
1
vote
0answers
22 views

Number of unique values for rank correlation to be valid

Are there any recommendations on a minimum number of unique rank values per variable for either rank correlation coefficient or significance of this coefficient to be valid. Is it recommended to ...
1
vote
0answers
57 views

How to correlate movie taste?

I am looking for the best known way to correlate movie taste, i.e. to determine which people out of a large pool deviate the least from your own movie scores. One site with this purpose is Criticker. ...
0
votes
1answer
30 views

What model should I use?

I was having a discussion with my father about building an index that ranks cities as a function of multiple variables. For example, ranking n=20 cities based on $$$/SQFT and air quality. I would ...
0
votes
0answers
15 views

How to compare the rankings of two groups?

I'm trying to compare the rankings of two different groups (states that voted Democrat and states that voted Republican). What test should I use? Based on some googling, it seems that I should be ...
6
votes
1answer
105 views

Correlation between an observation and its rank in a random sample

Suppose $X_1,X_2,\ldots,X_n$ are i.i.d random variables with an absolutely continuous distribution. We say the observation $X_i$ has rank $R_i$ if $$X_i=X_{(R_i)}\quad,\,i=1,2,\ldots,n,$$ where $X_{(...
1
vote
0answers
42 views

How to quantify the uncertainty in a single value obtained from a large number of simulations

Im a physics student working on a project in which I have to simulate a machine that would order a bunch of molecules according to their mass. I want to get a quantitative measure of how well the ...
1
vote
1answer
36 views

Can two imperfect rankings be combined to produce a better ranking?

So I've got a dataset that can be ranked in two noisy ways $R_1$ and $R_2$. Let's call $R_1$ and $R_2$ functions from the dataset $x \in R^N$ to a real number between 0 and 1. Since they are rankings ...
0
votes
0answers
29 views

ranking metric for a specific use case

I am trying to find the best "ranking metric" for my problem but could not find any existing suitable metric, can someone help. I'm interested in information retrieval. For item there is a "...
0
votes
0answers
17 views

Using clickthrough data for training a ranking function

Suppose that you have clickthrough data in the following form -- (query, clicked url, frequency). I wonder if there is any way of using the data to train a ranking function. Naively, you can treat ...
2
votes
0answers
31 views

What is the name of this test for the probability of differences between lists and is it valid?

And are there any better methods? In a 1969 book about investing, the author Burton P. Fabricand describes a method for assessing the effectiveness of a stock picker. Ask the picker to provide a list ...
3
votes
2answers
68 views

Is ratio of ranks a well-studied statistic?

I have two lists of recommendations: that is, two different algorithms have assigned ranks to the same list of objects. I would like to know if they're similar. I specifically care more about ...
0
votes
0answers
136 views

Expected average precision for random ranked list

Suppose we are evaluating the label ranking average precision (LRAP), which is an evaluation metric used to compare a ranked list to a ground truth (binary) label vector. Background and Definition ...
1
vote
0answers
44 views

Using Class Probabilities from Random Forest to do Ranking

Assume that we have set of documents which are being labelled as relevant and non-relevant. Can I used the class probabilities generated by Random Forest in python scikit-learn to rank the documents ...
1
vote
0answers
51 views

Random Forest in RankLib

I am building a LETOR model using Random Forest with RankLib. As we know that the Random Forest gets better with higher number of trees, I got a totally different observation in my case. The ...
0
votes
1answer
23 views

Robustness of ranking based on cross validation set, should I bootstrap?

I have a dataset that I separate into training and validation. I fit several models on the training set and then evaluate their performance on the validation set. When I rank the models based on their ...
0
votes
0answers
16 views

Rank Test for a Matrix

Suppose I have a matrix A corrupted with noise and I am looking for a test that tests the null hypothesis that the matrix A, rank(A)==1 v.s. rank(A)>1. I checked a little the literature and this paper ...
0
votes
0answers
44 views

Directly optimizing over AUC surrogate

This is in relation to this paper I am looking for ways to optimize Recall @ fixed Precision ($R@P$) for a machine learning problem and i didnt want to use accuracy as a proxy for $R@P$. Upon ...