Questions tagged [ranking]

Ranking is the task or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

Generalization of rank to two dimensions?

Converting numbers to ranks spreads the values out in one dimension so that they are equally spaced, while maintaining order. Is there an analogue for two dimensions, which spreads points out in a ...
0
votes
0answers
12 views

Find ranking to maximize average correlation to multiple known rankings

I have n measured rankings for k objects, which I want to combine such that the combined ranking maximizes the average correlation with the measured rankings. As correlation measures I need solutions ...
0
votes
0answers
10 views

Differentiable loss function for ranking problem with regression model

In regression problem, we may need a loss function to measure the relative ranking accuracy between targets $y$ and predicted values $y_{pred}$. Abviously, the simple MSE does not consider such ...
0
votes
0answers
18 views

Understanding Plackett Luce Model - how to derive it

I wanted to study how to derive PL model, but I could not find it using Google. Suppose I have three random variables $Y_1,Y_2,Y_3$ following logistic distribution with mean parameters $\theta_1,\...
-1
votes
0answers
23 views

Rank comparisons

If I have 2 sets of numbers, is there a test available that compares their ranking and provides an overall summary number. For example for the dummy data below, I want to know if the variable with ...
0
votes
0answers
69 views

How to compare sensitivity analysis results?

I have performed global sensitivity (Morris one-step-at-a-time) for two conditions, with/without treatment. The results are two list of parameters with according scores, e.g. ...
0
votes
0answers
14 views

ELO Ratings possible between groups and then individuals?

I'm putting together a little RPG that, like many, begins with character selection. One thing that frustrates me about many games if you have to make immutable decisions before you know what's useful. ...
0
votes
1answer
42 views

Which ML algorithms suits better for movie ranking?

I am trying to rank a movie based on user ratings. Which algorithm(s) should be used to rank them? I have just stars from 0 to 5 and movie names. Few movies have a lot of one star and a few a lot of 5 ...
0
votes
0answers
15 views

Similarity measure for two lists of scores

I have a finite set of items, a score for each item, and a series of orderings: ...
0
votes
0answers
15 views

Ranking tuples based on distinct ordered sets

Given $n$ sets of items where each item is mapped to an integer counter (higher is better): ...
1
vote
1answer
39 views

Determining whether a change in ranking is statistically significant

I have two populations, A (n=48) and B (n=19). Both took a pre-test, after which B performed an intervention. Both A and B took ...
2
votes
0answers
33 views

Clustering with ranking data [duplicate]

I'm just trying to get some practice with implementing some Machine Learning algorithms with a variety of data. I'm just getting started so I'm pretty new to the whole process and would appreciate any ...
1
vote
1answer
39 views

Compare two ranked lists of words

I have looked around and I'm not sure I've seen an appropriate answer though this questions is, I think, similar: Comparison of ranked lists it does not answer my question - which more succinctly ...
0
votes
0answers
139 views

comparing averages versus comparing the averages of percentage

There are three rooms with 40 identical boxes in each room. Each box contains some number of cards inside. The number of cards in each box is different. It may be as many as 60 cards in one box and as ...
1
vote
0answers
15 views

Rank correlation with only incomplete pairwise comparisons?

I am studying the online ad ecosystem and would like to study the relationship between prices advertisers pay to show an ad and the preferences of users. In particular, I have a set of observations ...
0
votes
0answers
46 views

How to create a score for a SWOT matrix (strengths, weaknesses, opportunities, and threats)

I'm developing a participatory social environmental diagnostic. To do this, I'm using primary (qualitative data from interviews with stakeholders) and secondary data (local socioeconomic data). From ...
1
vote
0answers
21 views

Ranking metric that takes into account length of result list?

I would like to evaluate a problem where the user select an option from a list of variable length. The task is to provide a ranked list so that the item lower in rank is the most relevant. If I use a ...
1
vote
1answer
23 views

How to rank data based on cross-validation

I had this problem from a long time. I have small dataset with about 1000 data points. The data is labeled as 1 or 0 (i.e. ...
0
votes
0answers
14 views

Binary Matrix Low Rank Matrix Factorization

Low Rank Matrix Factorization is a pretty popular problem in data mining. We need to find 2 matrices, $W, H$ such as $F = W \cdot H$. I know that this approximation is NPC problem, so we won't find ...
3
votes
0answers
24 views

When should one use Bradley-Terry instead of gradient boosted trees for pairwise ranking

Both the Bradley-Terry model and Gradient boosted trees can be used to learn a ranking from pairwise comparisons (e.g. with libraries choix and XGboost). How do they relate to each other? Is there ...
0
votes
0answers
14 views

How to Rank Parameters using Sobol Indices (Variance-based Ranking)

I am trying to compare different parameter ranking methods. The Sobol Indice method is the most representative method for ranking significant parameters based on contribution to output variance, ...
0
votes
2answers
22 views

How to rank measurements in a survey?

I've designed a Likert-scale survey with 4 measurements: x (it has 6 items/questions) y (it has 9 items/questions) z (it has 7 items/questions) w (it has 3 items/questions) How can I rank these ...
1
vote
1answer
23 views

Reducing a pool of 175 applicants to a list of 20 applicants from 3-factor evaluations

I’m chairing a search committee for an academic position. We have a pool of 175 candidates and a committee of 5 who will rank each candidate in three different factors, using scores from 1(lowest)–4(...
0
votes
0answers
17 views

Missing data not at random imputation for a ranking

Let's say I am interested in the differences in intelligence of 200 individuals, based on a huge database which ranks almost the entire population. The database do not record intelligence scores, but ...
0
votes
1answer
29 views

Does it make a differences to a prediction model if a factor is ordered or not?

I want to build a prediction model where one predictor variable is a score of roman numeral I, II, III, and IV. I am using R and I currently store this feature as factor. This, however, is not ...
0
votes
0answers
16 views

Can I use learning to rank to recommend products to customers?

I am working on a project to recommend products to customers. I knew the traditional methods was to use recommendation systems. I wonder if I could use learning to rank to provide the best-ranked ...
1
vote
0answers
10 views

Options for nonparametric preference ranking models

What are some options for nonparametric ranking models with a probabilistic interpretation? I'm basically looking for a nonlinear/nonparametric version of a rank ordered logit model. I'm aware of ...
1
vote
0answers
27 views

How to show that ranking is maintained across conditions?

Let's say I have four different classrooms of students, and they all take two tests. How do I show that the ranking of the classrooms is maintained across the two tests? e.g. classroom 3 does the best,...
3
votes
0answers
24 views

non-parametric circular statistics

I am working on a research question of color preference (which can be represented in a circular space). I have divided the circular space into 16 equally spaced bins and done a pairwise comparison ...
1
vote
0answers
13 views

How to test if my population is orderable?

I perform repeated experiment, which takes, e.g. 1s, such that time $t \in [0,1]$. I observe variable $x$, which is an event. So for each experiment $i$, $x=1$ at some random time $t_i$, and $x=0$ the ...
0
votes
1answer
24 views

Kendals tau-b correlation with lots of 0 variance columns

I am writing a paper that is meant to establish that certain algorithms rank candidate values accross multiple problems in a different way. To do this, I take Algorithm A and run it on the candidate ...
0
votes
0answers
24 views

Incorporating head to head results in model predicting winner of multi-player game

I am using a rank-ordered logit model to predict the winner of a multi-player game (think Fortnite). Among other individual-level factors (e.g., strength of each player, experience or number of games ...
2
votes
0answers
238 views

Learning to rank for time series with LightGBM data formatting

I have multiple time series, one for each item, say item1, item2,...itemN. N>=500. I have features associated for each of the items and a dependent variable. I am currently studying learning to rank ...
5
votes
0answers
142 views

Probability of selecting maximum in bivariate correlated order statistics?

In a testing, ranking, or selection scenario, we have samples of size n where a measurement is correlated 0<r<1 with some second variable of interest; they are bivariate normally distributed. We'...
0
votes
0answers
21 views

Ranking groups based on multiple criteria

My objective: To give a more sound foundation to the data I have access to. This is an exercise that is aimed to look for some structure and soundness in the interpretation of the data BUT it can be ...
0
votes
1answer
196 views

How to use chi-square for ranking?

I came across this recent KDD paper titled as Concepts-Bridges: Uncovering Conceptual Bridges Based On Biomedical Concept Evolution. In page 6 of the paper they have used ...
0
votes
0answers
7 views

Imagine N samples are rank-ordered in K different ways, is there a method to choose “best” sample?

Imagine a problem where N samples are rank-ordered using K different scoring functions (producing an order for each of the K functions). These scoring functions do not necessarily agree, but one can ...
1
vote
0answers
18 views

AUC-like measure for multiple simultaneous classification tasks?

I know that given an ordered set of binary labels, and equally-sized ordered set of scalar predictions, we can quantify how cleanly the predictions separate the labels into clean buckets of 0's and 1'...
1
vote
1answer
33 views

Need to randomize rank order,

I have a ranking of items, $X = (x_1, \ldots, x_n)$. I want to obtain a random sequence $\hat{X}$, which is a permutation of $x_i$, such that the expected rank-correlation (say, Kendall) between $X$ ...
0
votes
0answers
15 views

Ranking Methodology

I came across an interesting method of ranking entities (products) today, and I wanted to hear some perspectives on this approach. Basically, the assessment asks a set of 30 personal value statements ...
1
vote
3answers
52 views

What is the most appropriate way to cluster respondents based on their rankings of some items?

I have ~30 observations of individuals ranking 20 different products from top to bottom (1-20). I would like to have a way to "cluster" these individuals based on their rankings of the different ...
0
votes
0answers
27 views

Understanding the stochastic part of rank-based inverse normal transformation

I'm checking out some methods for rank-based inverse normal transformation in Python and found this: https://github.com/edm1/rank-based-INT/blob/master/rank_based_inverse_normal_transformation.py ...
1
vote
1answer
37 views

Figuring out the US Hospital Rankings equation

I'm attempting to figure out how the equation works for the scores of hospitals in the US News & World Report 2018-2019.$^\dagger$ Specifically, I'm having trouble with the log transformation ...
0
votes
0answers
18 views

Building an index as dep. for regression

I have two dependent variables: the health and the environmental impact of individuals’ diets. Both variables are continuous but on different scales/ranges. For both high values/impacts are bad. I ...
0
votes
0answers
64 views

Can NDCG be used a metric for evaluating implicit feedback based recommender systems?

If we are using binary feedback then Can NDCG be used a metric for evaluating implicit feedback based recommender systems
1
vote
0answers
21 views

Identify difficult parameter to measure [closed]

I am using different tools to measure x on some objects. The tools were tested on a small set of objects for which the true x is known. And so the predicted values were found to not be accurate for ...
0
votes
0answers
37 views

Ranking news pages with time series data

News pages have some static features like the number of words on the page, number of hyperlinks, etc., which do not change with time, while some features are time-variant like page views and number of ...
2
votes
1answer
16 views

Models for ranking possible classifications by confidence

What are good means of finding the various highest confidences or likelihoods for a (say) hundred possible outcomes of a classification problem? Inputs belong to only one class, unlike document ...
0
votes
1answer
148 views

Is ordinal regression a classification or a ranking problem?

I’m confused, in wikipedia, ordinal regression is also referred as ordinal classification. Which makes sense since ordinal variables are in the end just categorical. On the other hand, ordinal ...
0
votes
1answer
64 views

Dummy coding, ranking of categorical variables

I need to rank categorical variables (top 5 reasons for staying married, top five reasons for divorce). I need to find a method for dummy coding these variables, and then ranking/weighting them (for ...

1 2 3 4 5 11