Questions tagged [ranking]

Ranking is the task (for respondents) or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).

662 questions
Filter by
Sorted by
Tagged with
1 vote
35 views

How to create a rank from ranks?

I have calculated ranks for each row based on a condition on each column. Now I have, ...
1 vote
40 views

Computing heuristic from winrate and number of games

I need to sort big sets of players (of a MOBA) based on their performance represented by their - number of - games and their winrate on these games. I reduced the initial set of players based on their ...
12 views

fuzzy decission making

I'm working on decision-making using Double Hierarchy Fuzzy Linguistic terms. I want to ask if can we compare two Double Hierarchy Fuzzy Linguistic terms. I am trying to implement the TODIM algorithm ...
1k views

What is the best way of combining multiple rankings into one?

Suppose I have $N$ different items to be ranked, and $M$ different people who provide a ranking of the items according to their personal preference. What is the best way of combining all rankings into ...
• 213
36 views

Effective pairwise comparisons for group ranking?

Suppose I have a list of items(~3500 in number) and I want to do a group based ranking into 4-5 groups. I can get pairwise comparisons between the elements but I want to choose the items to compare in ...
1 vote
19 views

Finding the most-similar color palette [closed]

I have a dataset of several thousand color palettes: for each row in a dataset, I have the ten most common RGB values in an image, and the fraction of that color in the overall image: ...
51 views

Predicting the order/ranking of continuous observations

I have a problem that is kind of similar to ordinal regression, but not the same. If I understand it correctly, in ordinal regression we try to predict ordered labels, e.g. the number of stars a book ...
1 vote
100 views

Estimating maximum effect size and Skillings-Mack test

I'm working with data that fit the Skillings-Mack test: unbalanced incomplete block design. Or Friedman-test-like with missing data. In case of negative test result I'd like to estimate the maximum ...
• 190
237 views

How to rank data based on multiple variables

I need help in ranking data, says car models in this case, based on multiple variables. For some variables (eg. mpg), the higher the better. For some variables (eg. car age), the lower the better. For ...
• 79
1 vote
50 views

A Rank comparison test? [closed]

Is there a test that one can use to perform rank comparison tests. In other words if I have 2 variables (say income in all 10 regions of country X; and, income in all 10 regions of country Y) and I ...
• 11
1 vote
47 views

Correlations among rankings

In my study, participants ranked their preferences for several choices. Because moving one choice up necessarily means moving one or more choices down, nearly all correlations (Pearson's r) are ...
150 views

XGBoost Learning to Rank with XGBClassifier

I am trying to build a model trained on binary labels that has a high precision for the top k predicted instances, and don’t care too much about recall or precision more generally. I was then ...
• 228
1 vote
21 views

Compare multiclass probabilities for two classifiers

I have two algorithms that produce, for every observation, a vector of probabilities for 3 classes ...
143 views

Is the relation "not FOSD" transitive?

$X:\Omega\to [0,1]$ is a random variable. It is known that first order stochastic dominance FOSD is a partial order that is transitive: $X$ FOSD $Y$, $Y$ FOSD $Z$ implies $X$ FOSD $Z$. Now consider ...
• 823
1 vote
41 views

Model test sensitivity to ability

I have a set of tests and a population of agents whose ability I want to assess. Each agent has taken some of the tests. The agents have no memory of the tests they have taken, so each time an agent ...
• 183
32 views

Nonparametric test (akin to a sign test?) for multiple interacting effects across multiple conditions

Problem I have $K$ sets of conditions (index by $k\in\{1,..,K\}$), and each set has $N_k$ conditions. For example, if $K=2$ and $N_1=N_2=2$, we could call the conditions (A,B) and (C,D). I have ...
• 261
45 views

Determine "best" winrate between data with different sample sizes

Setup I've a collection of winrates where each winrate represents a particular combination of "power ups" a player can select for a character they play in a game. The numerator represents ...
• 28
34 views

How to evaluate the validity of my teaching methods through analyzing the data of the students' ranks in a grade through time?

I also posted the question at https://math.stackexchange.com/questions/4793565/how-to-evaluate-the-validity-of-my-teaching-methods-through-analyzing-the-data-o Problems I want to solve I want to be a ...
26 views

Comparing proxy metrics to human evaluations

I have two proxy metrics, and I'd like to see which of them correlates more strongly with human ratings. I have ~30 questions, and for each question 3 humans independently give a score on a 1-10 scale....
• 101
752 views

Hypothesis testing for a sequence (ranking)

Let's say I must taste and rank 4 bottles of wine by price. The true ranking is [X,Y,Z,W]. The ranking I provide after tasting is [X,Y,W,Z], where X,Y,Z,W are different bottles of wine. Which ...
• 403
1 vote
54 views

Modeling player interactions in multi-dimensional rating systems

In traditional rating systems (such as Elo), a player's strength is represented by a single scalar value, which is assumed to be consistent across different opponents. However, in some games, the ...
• 11
70 views

Between group analysis for ranked data in spss

I have ranked data where participants were asked to rank 8 choices from 1-8. The data is in spss and is in the wide format, where each choice is its own variable (column). There can be no ties. I ...
43 views

rank aggregation with partial ranking lists

My question is about rank aggregation, which is in relation with statistics and decision sciences. (if this question is off the topic of this site, plz let me know.) The question is that I have N ...
11 views

Optimal formula to predict product when one of the components is certain

When an item is clicked, it generates revenue equal to the cost per click (CPC). As such, revenue = I(click) x CPC. I want to select the item with highest expected ...
105 views

Example probability model predicting vectors of ranks?

Background I'll confess, I like Richard McElreath's lectures so much that I've been watching his backlog of lectures (even though I've already seen all of the recent lectures of the same course). In ...
• 9,381
1 vote
22 views

calculating a statistically significant difference in means between groups

A large number of subjects repeatedly pass or fail a test. The test frequency is irregular and randomized per user. Organize this data set in groups by the average test frequency being once per week (...
• 11
18 views

Scoring races + ranking index, with Bayesian approach

Challenge: Is this the best approach for scoring multicompetitor races? How do I account for both uncertain prior & uncertain evidence when scoring? Case: athletes getting scores in each race, ...
34 views

Best way of determining how unique an inspector's ratings are compared to the average inspector

Noob question. I have a full population of every inspector rating for all items being rated. Each inspector has inspected a subset of the items and given them a rating, but different inspectors have ...
108 views

What are the undefined constants and functions in Stern's 2011 paper?

I'm reading the 2011 paper on ranking called Moderated Paired Comparisons by Steven E. Stern and there are no definitions given for some of the constants and functions in equation 1. As you can see, ...
1 vote
45 views

Rank clusters based on mean feature value and variance feature value of the cluster

I would like to rank clusters according to their importance. From 113 demand time series data I extract the following 6 features from each time series. "Average Demand", "n95 demand&...
29 views

Implementing a collaborative filtering model for recommending items to new users and how to evaluate it

I have some data for a collaborative filtering problem, which can be represented in a user-item interaction matrix. The data consists of 20 million orders, where there are 15000 different items, and ...
40 views

Need help defining the theoretical covariance matrix between a parameter and two distinct estimators

I have a problem that resembles SEM or factor analysis, but the indicators are estimators of the parameter, not empirical observations of random variables. The model is a one-factor model with two ...
• 642
1 vote