The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [ranking]

Ranking is the task or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).

Filter by
Sorted by
Tagged with
1
vote
0answers
25 views

How to show that ranking is maintained across conditions?

Let's say I have four different classrooms of students, and they all take two tests. How do I show that the ranking of the classrooms is maintained across the two tests? e.g. classroom 3 does the best,...
2
votes
0answers
14 views

non-parametric circular statistics

I am working on a research question of color preference (which can be represented in a circular space). I have divided the circular space into 16 equally spaced bins and done a pairwise comparison ...
1
vote
0answers
13 views

How to test if my population is orderable?

I perform repeated experiment, which takes, e.g. 1s, such that time $t \in [0,1]$. I observe variable $x$, which is an event. So for each experiment $i$, $x=1$ at some random time $t_i$, and $x=0$ the ...
0
votes
1answer
23 views

Kendals tau-b correlation with lots of 0 variance columns

I am writing a paper that is meant to establish that certain algorithms rank candidate values accross multiple problems in a different way. To do this, I take Algorithm A and run it on the candidate ...
0
votes
0answers
22 views

Incorporating head to head results in model predicting winner of multi-player game

I am using a rank-ordered logit model to predict the winner of a multi-player game (think Fortnite). Among other individual-level factors (e.g., strength of each player, experience or number of games ...
1
vote
0answers
15 views

Learning to rank for time series with LightGBM data formatting

I have multiple time series, one for each item, say item1, item2,...itemN. N>=500. I have features associated for each of the items and a dependent variable. I am currently studying learning to rank ...
3
votes
0answers
70 views

Probability of selecting maximum in bivariate correlated order statistics?

In a testing, ranking, or selection scenario, we have samples of size n where a measurement is correlated 0<r<1 with some second variable of interest; they are bivariate normally distributed. We'...
0
votes
0answers
17 views

Ranking groups based on multiple criteria

My objective: To give a more sound foundation to the data I have access to. This is an exercise that is aimed to look for some structure and soundness in the interpretation of the data BUT it can be ...
0
votes
0answers
7 views

Imagine N samples are rank-ordered in K different ways, is there a method to choose “best” sample?

Imagine a problem where N samples are rank-ordered using K different scoring functions (producing an order for each of the K functions). These scoring functions do not necessarily agree, but one can ...
1
vote
0answers
18 views

AUC-like measure for multiple simultaneous classification tasks?

I know that given an ordered set of binary labels, and equally-sized ordered set of scalar predictions, we can quantify how cleanly the predictions separate the labels into clean buckets of 0's and 1'...
1
vote
1answer
30 views

Need to randomize rank order,

I have a ranking of items, $X = (x_1, \ldots, x_n)$. I want to obtain a random sequence $\hat{X}$, which is a permutation of $x_i$, such that the expected rank-correlation (say, Kendall) between $X$ ...
0
votes
0answers
13 views

Ranking Methodology

I came across an interesting method of ranking entities (products) today, and I wanted to hear some perspectives on this approach. Basically, the assessment asks a set of 30 personal value statements ...
1
vote
2answers
28 views

What is the most appropriate way to cluster respondents based on their rankings of some items?

I have ~30 observations of individuals ranking 20 different products from top to bottom (1-20). I would like to have a way to "cluster" these individuals based on their rankings of the different ...
0
votes
0answers
20 views

Understanding the stochastic part of rank-based inverse normal transformation

I'm checking out some methods for rank-based inverse normal transformation in Python and found this: https://github.com/edm1/rank-based-INT/blob/master/rank_based_inverse_normal_transformation.py ...
1
vote
1answer
37 views

Figuring out the US Hospital Rankings equation

I'm attempting to figure out how the equation works for the scores of hospitals in the US News & World Report 2018-2019.$^\dagger$ Specifically, I'm having trouble with the log transformation ...
0
votes
0answers
16 views

Building an index as dep. for regression

I have two dependent variables: the health and the environmental impact of individuals’ diets. Both variables are continuous but on different scales/ranges. For both high values/impacts are bad. I ...
0
votes
0answers
36 views

Can NDCG be used a metric for evaluating implicit feedback based recommender systems?

If we are using binary feedback then Can NDCG be used a metric for evaluating implicit feedback based recommender systems
1
vote
0answers
20 views

Identify difficult parameter to measure [closed]

I am using different tools to measure x on some objects. The tools were tested on a small set of objects for which the true x is known. And so the predicted values were found to not be accurate for ...
0
votes
0answers
34 views

Ranking news pages with time series data

News pages have some static features like the number of words on the page, number of hyperlinks, etc., which do not change with time, while some features are time-variant like page views and number of ...
2
votes
0answers
11 views

Models for ranking possible classifications by confidence

What are good means of finding the various highest confidences or likelihoods for a (say) hundred possible outcomes of a classification problem? Inputs belong to only one class, unlike document ...
0
votes
1answer
64 views

Is ordinal regression a classification or a ranking problem?

I’m confused, in wikipedia, ordinal regression is also referred as ordinal classification. Which makes sense since ordinal variables are in the end just categorical. On the other hand, ordinal ...
0
votes
1answer
32 views

Dummy coding, ranking of categorical variables

I need to rank categorical variables (top 5 reasons for staying married, top five reasons for divorce). I need to find a method for dummy coding these variables, and then ranking/weighting them (for ...
1
vote
0answers
30 views

How to determine bang-for-buck apart from just $/TB

Firstly, I'm no expert on statistics or any of the fancy jargon so please pardon my ignorance and use of layman terms! Also, forgive me if this is not the right forum to post my question. So I've ...
0
votes
2answers
34 views

Evaluate methods across datasets based on distance metrics

I want to evaluate $n$ methods, says $M_1,\cdots,M_n$ on $m$ datasets $D_1, \ldots, D_m$. For each method $M$, I have a score function $f(M,D) \in [0, \infty)$ for dataset $D$. A perfect method will ...
0
votes
0answers
36 views

How to derive a ranking function from observations [duplicate]

I have a employee dataset with the following 5 details. projects completed customer ratings number of bugs reported customer complaints profit I want to rank ...
0
votes
0answers
35 views

Seeking a general solution to confidence intervals around ranks

Often test takers are ranked based on their test scores (e.g., people taking a civil service exam) and often those test scores are rounded before being ranked, producing many ties). How might I go ...
0
votes
0answers
10 views

How to plot Ranked Linear Regression values in original data plot?

Left Image Shows original EUR/USD values and the corresponding Regression line based on the original values. Right Image Shows the ranked values and ist corresponding ranked Regression line. Values ...
0
votes
1answer
51 views

How to convert classification features into a ranking function?

I am using 3 features (x1, x2, x3) for binary classification. All my feature values are in 0 to 1 range (unit range). I obtained how important each feature was in classification as follows (i.e. <...
1
vote
1answer
26 views

Average rank with different number of ranked items

Say I have a set of my top 100 favorite movies from a list of 1000 possible choices $$ \{M_1,M_2,..., M_{100}\} $$ And have asked my friends to guess my top movies by ranking them in order of ...
1
vote
1answer
18 views

Is Using Differnet Evaluators for Head-to-Head Competing Grants a Fair Process?

We evaluate around 100 grant proposals each year using a team of 15 evaluators who all use the same criteria. 100 grant proposals is a lot for any one evaluator to do and they are experiencing ...
4
votes
1answer
35 views

Crew selection: ranking rowers by letting them race against each other

Seat selection is a common practice in competitive rowing and I would be curious about more solid statistical underpinnings: there are more rowers in a team than the 8 seats in the crew boat. So the ...
0
votes
0answers
15 views

Proxy for Mahalanobis distance when n < p? [duplicate]

I'm working on a ranking problem where I want to measure the distance between a collection of query points (as a group) and each target point in my database. Each query point is part of the set of ...
0
votes
0answers
68 views

How to derive a ranking function by analysing feature correlations

I am analysing some employee details to find the efficiency of the employees. Ideally I want some rankings to rank them based on these features. My features include; current salary projects ...
1
vote
2answers
362 views

How to interpret / metric Lasso regression coefficients

Edited Question, since it was a duplicate I used Matlab to make a lasso model for my data that has 41 predictors and 1 response variable, and perhaps I used more variables that I need too or maybe ...
0
votes
0answers
12 views

ranking unrelated items

I am trying to rank some related/unrelated items and asking for your help in the identification of a solution. Let assume that we ask a person whether he likes fruits and vegetables, and he replied ...
0
votes
0answers
15 views

How to penalize for empty fields in DataFrame?

I have to calculate the consistency of racing car drivers during the whole season. My DataFrame consists of 10 columns (10 circuit names) and for each of those columns I have the standard deviation in ...
1
vote
0answers
30 views

Statistical methods for assigning weights based on rank differences?

I have encountered methodological problem in my pursuit of my master's degree, and I hope you can help! I know exactly what I want to do, but I do not know which statistical area this is related to. I ...
0
votes
0answers
26 views

How to evaluate the performance of ranking methods of items with binary and multiple labels?

I hope that you're all fine. I have two different datasets: Dataset 1 has 10 samples: 4 labelled as 'positive' and 6 as 'negative'. Dataset 2 has 10 samples: 3 labelled as 'high', 4 labelled as '...
0
votes
1answer
35 views

convert ranking to points value

I am trying to take several 'ranking' lists add weighted values and come up with a net score to compare. Take the PGA tour players. I would like to take putting, driving and chipping and convert rank ...
0
votes
0answers
33 views

Ranking based on 2 measures

Please help me what method should I used to find the best performing schools as some schools have nearly 1000 students attended exam where as for some schools nearly 100 students attended. How can I ...
2
votes
0answers
15 views

Ranking Metric for 3 elements [Not in the information retrieval sense]

I'm working on a problem which requires me to rank 3 products based on the preferences (i.e. how much a user likes them). Let's say products are A, B, and C I have the ground truth: A > B > C i.e. ...
1
vote
0answers
29 views

Rank non-normally distributed sets of integers: long read sequencing and phase blocks

I have about 20 arrays of empirical integer values, which are each not normally distributed, with long tails. I am looking for a 'sane and sound' metric on how to sort these distributions, "with ...
1
vote
0answers
17 views

interpreting rank difference trend

I am doing some research utilizing popularity ranks in periodic data. I've been able to model the rank data using Zipf Law effectively. I am interested in understanding how the rank changes, as well. ...
0
votes
0answers
13 views

Multilevel generalized linear model (MGLM) with rank dependant variable : Specification issues

I am currently trying to estimate a multilevel generalized linear model (MGLM) on rank data using clmm function from "ordinal" R package. My dependant variable is a ranking variable repeatidly ...
3
votes
0answers
25 views

Comparing a predicted order of events to actual order of events

Sorry about my somewhat limited knowledge of statistics, it's just this is a tad too complex for my knowledge of the subject. I'm running a competition where entrants are told what events happen, and ...
1
vote
2answers
53 views

Developing a simple scoring system for client performance

I was hoping someone can point me in the right direction to develop a simple scoring system or algorithm on clients revenue performance over a period of time. I have over 400 clients with their ...
1
vote
0answers
22 views

What is the best method to rank elements with multiple attributes

This is Kumar, the fire beast monk. The left numbers are the base stats, the green numbers are the stats provided by the equip runes. Depending on your runes you can make your monster more stronger. ...
0
votes
0answers
28 views

Theoretically is it better to sample with or without replacement to approximate a rank test?

Let's say we want to do a rank test since we do not know the exact distribution. Say we have 3 different sample sizes. Which of the following tests (exact permutation, sample with replacement, sample ...
0
votes
0answers
9 views

% variation on 1/x function

My data (X) is the rank position of units sales (y). Eg. x=1 top seller, x=1000 is the 1000th top seller I know that sales number can be estimated by: units(x) = $N_0x^{(-0.5)}$ Now I would ...
1
vote
0answers
42 views

What statistical tools are available to remove bias from a dataset?

Three managers report to me. They have done appraisal of staff under them giving them a percentage. I have to sign-off those ratings but I face two major issues: The managers have a certain way of ...