Questions tagged [ranking]
Ranking is the task (for respondents) or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).
659
questions
0
votes
0
answers
9
views
Optimal formula to predict product when one of the components is certain
When an item is clicked, it generates revenue equal to the cost per click (CPC). As such, revenue = I(click) x CPC. I want to select the item with highest expected ...
1
vote
1
answer
75
views
Example probability model predicting vectors of ranks?
Background
I'll confess, I like Richard McElreath's lectures so much that I've been watching his backlog of lectures (even though I've already seen all of the recent lectures of the same course).
In ...
- 6,988
1
vote
0
answers
19
views
calculating a statistically significant difference in means between groups
A large number of subjects repeatedly pass or fail a test. The test frequency is irregular and randomized per user.
Organize this data set in groups by the average test frequency being once per week (...
- 11
0
votes
0
answers
14
views
Scoring races + ranking index, with Bayesian approach
Challenge: Is this the best approach for scoring multicompetitor races? How do I account for both uncertain prior & uncertain evidence when scoring?
Case: athletes getting scores in each race, ...
2
votes
0
answers
28
views
Best way of determining how unique an inspector's ratings are compared to the average inspector
Noob question.
I have a full population of every inspector rating for all items being rated. Each inspector has inspected a subset of the items and given them a rating, but different inspectors have ...
2
votes
1
answer
104
views
What are the undefined constants and functions in Stern's 2011 paper?
I'm reading the 2011 paper on ranking called Moderated Paired Comparisons by Steven E. Stern and there are no definitions given for some of the constants and functions in equation 1.
As you can see, ...
- 33
0
votes
0
answers
11
views
Rank clusters based on mean feature value and variance feature value of the cluster
I would like to rank clusters according to their importance.
From 113 demand time series data I extract the following 6 features from each time series.
"Average Demand", "n95 demand&...
- 244
0
votes
0
answers
24
views
Implementing a collaborative filtering model for recommending items to new users and how to evaluate it
I have some data for a collaborative filtering problem, which can be represented in a user-item interaction matrix. The data consists of 20 million orders, where there are 15000 different items, and ...
0
votes
0
answers
21
views
Need help defining the theoretical covariance matrix between a parameter and two distinct estimators
I have a problem that resembles SEM or factor analysis, but the indicators are estimators of the parameter, not empirical observations of random variables. The model is a one-factor model with two ...
- 336
1
vote
0
answers
20
views
Are paired matches in ranked data independent, if the original, unranked, continuous pairs are independent?
Let $(X, Y)$ be a randomly drawn sample of $n$ paired observations from a bivariate continuous population. It is clear that each pair is independent of the others, both pairwise and mutually. Let $R(X,...
- 336
0
votes
0
answers
26
views
How do I test the significance of a distribution of tau coefficients?
I have (I think) a simple question. I estimated rank-orderings on a variable from a sample of 225 people, and I'm interested to know whether they generally correlated with a "correct" rank-...
- 109
0
votes
1
answer
59
views
Weighted Spearman Rank correlation proof
I have been searching for alternate measures to compute spearman rank correlation that incorporates some sort of weighting in the calculation. I came across this
paper by David C. Blest on weighted ...
- 393
0
votes
0
answers
42
views
Bayesian estimation for a ranking outcome variable
I'm interested in modeling how a ranking depends on a continuous feature. I have many related groups of these rankings, so I want to use partial pooling with the usual Bayesian machinery, but I'm ...
- 101
3
votes
0
answers
87
views
How to determine sample size for number of pairwise comparisons for item ranking
Suppose I have 100 items and I would like to come up with their ranking based on user preferences. i.e. each item should receive a rank from between 1-100, where 1 is the most preferred item and 100 ...
- 331
0
votes
1
answer
30
views
Rank Neurons Importance of the latent space of an Autoencoder using PCA
I am trying to extract only the important neurons from the latent space of an Autoencoder to be converted later to a pattern for a model pattern recognizer.
PCA Loadings helps in finding the highest ...
0
votes
0
answers
8
views
Mean AUC vs Mean Average Precision?
Both AUC and Average Precision (AP) are commonly used to evaluate the quality of a ranked list of relevant / irrelevant documents. When evaluating a search engine, we want to evaluate the quality over ...
- 1,157
0
votes
0
answers
17
views
Analyzing pick, group & rank data
Participants completed a survey containing a pick, group and rank question. In detail, they were provided 16 items and asked to choose the ones that are relevant to them. Afterwards, they should rank ...
- 109
1
vote
0
answers
49
views
How to Compute Weighted Kendall's Tau for Health Data?
I am analyzing a dataset that includes sequences of patients and their associated health values, both provided by different doctors. Each sequence represents the treatment order, and the health values ...
- 111
1
vote
1
answer
37
views
Best way to rank list of values having overlapping uncertainties
I have a list of individuals and their success rates on a task. The count of tasks for each varies widely, so the uncertainty in the estimates of their proficiency varies. Furthermore, typical ...
- 111
1
vote
2
answers
44
views
Statistical model for likelihood that an athlete will "place" in track and field
I'm trying to come up with some sort of statistical model to predict how likely an athlete would be to place in a track and field event (e.g. 100m run) based on their time. I was thinking it would be ...
- 111
0
votes
0
answers
17
views
Comparing two ranked list with scores
I want to compare two ranked lists with items and their confidence scores assigned by the model. The lists are non-conjoint, i.e. can have different items. The number of items is the same for both ...
- 1
4
votes
1
answer
289
views
Comparing frequencies or proportions between two groups to find differences
Suppose I have two groups of users, A and B. In case it is relevant, B is much smaller than A.
I have a feature of products purchased across two groups. I want to find items whose popularity is ...
5
votes
1
answer
201
views
Ranking of multiple raters with partially overlapping assessments
Ranking of Raters and Cases
I am looking for a method for ranking a set of raters with partially overlapping binary assessments. I also want to rank the cases according to their difficulty.
Context
I ...
- 59
1
vote
0
answers
24
views
Statistical methods for ranking units
The problem: Suppose I have an ordered sample of $n$ observations (e.g. a playlist of songs) that are ranked according to some latent (unobserved) feature, for each of which $p$ covariates are ...
- 56
0
votes
0
answers
12
views
Synthetic variable with PCA
I have some variables regarding companies' workers, and I'd like to come up with a way of rankings these companies according to this data.
Say I have the following variables: number of technicians, ...
- 1
0
votes
0
answers
31
views
Feature Selection: Select top best features based on feature scores produced by different algorithms
I like to do feature selection and I am using multiple feature selection algorithms provided by sklearn. What I have done is, use a bunch of feature selection algos and get the score for each feature. ...
- 101
0
votes
0
answers
13
views
Supervised ranking algorithms
I'm working on a problem statement which involves ranking some short-lived items in an order such that the items expected to sell the most in the next n days are ranked on top - basically ranking ...
- 101
0
votes
0
answers
46
views
Does the rank transform preserve signum of Spearman correlation between parameter estimates across samples?
Suppose we have real-valued random variables $X$, $Y$, with noise $\epsilon$ that is independent of $X$ and $Y$ and $\mathbb{E}[\epsilon] = 0$, and measurable function $f$.
I am thinking about ...
- 6,988
1
vote
0
answers
42
views
Ranked data and hypothesis testing
I have a few questions regarding ranked data and hypothesis testing.
Hypothesis: Car drivers are more likely to consider the car as the most beneficial transportation method for mental health than ...
2
votes
1
answer
50
views
Optimizing XGBClassifier for discrimination power
I am developing a credit risk decisioning model, i.e. a model that assesses the risk of default of an incoming transactions and decides whether to accept it or not. Of course my dataset is imbalanced :...
- 21
1
vote
1
answer
108
views
Distribution of the rank of a sample from a normal distribution among a set of samples from a different normal distribution
I draw a single sample from a given standard normal distribution: $Y \sim N(0, 1)$. I also draw $n$ samples from a different normal distribution: $X_i \sim N(\mu, \sigma^2)$ for $i=1...n$. What is the ...
- 17.3k
2
votes
0
answers
40
views
What is the best way to combine individual rankings to provide an overall group ranking?
If I have 50 people randomly split into 5 groups of 10 people, I can rank the groups based on their combined weight. If I were to rank each person based on their individual weight, what would be the ...
- 21
1
vote
0
answers
15
views
Is this a learning to rank problem? [duplicate]
I'm stuck on a problem I'm trying to "translate" into ML terms so as to dig deeper into the literature.
Setup
I have n samples for which I generate k $\in (0, 40]$ different low-dimensional ...
0
votes
0
answers
25
views
Best statistical model for ranked preferences
I need some help figuring out the best statistical model for my planned research.
Here is the setup: I want to understand support for four distinct policies. More specifically, I want to understand ...
- 111
2
votes
0
answers
11
views
I need to create a neural network architecture for learning to rank task
I need ranking comments according to the text. They are represented by a vector representation from Sentence transformers. One text and 5 comments, and a score from 0 to 4 for each comment.
I need ...
- 121
2
votes
0
answers
35
views
Comparing the similarity of ranked word lists with a reference standard
Imagine a scientific organisation wants to communicate the likelihood of particular events occurring. For consistency, the organisation decides to always draw from the same set of words, which it ...
- 21
0
votes
0
answers
38
views
Interrater agreement for rankings on multiple objects
I asked 5 raters to rate 3 differently styled images from a total of 100 people (styles such as b&w, highly saturated, and natural colors).
Since each person has 3 images attached, each rater ...
- 60
1
vote
0
answers
27
views
Unsupervised Ranking
Assume we have N data points like
data = [(x1, y1, z1), (x2, y2, z2),....., (x_N, y_N, z_N)].
I am looking for unsupervised ranking algorithms. The thumb of rules ...
- 357
1
vote
0
answers
17
views
Is It Make Sense to Combining Feature Ranking Methods by Averaging The Ranking Results?
I have two separate filter-based feature ranking methods, i.e., Relief and mrMR. The ranking was (1st to 200th) have been acquired from both of these methods. Is it make sense if I combine these two ...
- 41
8
votes
4
answers
1k
views
What is a rank?
I've been thinking about unifying some notions related to ranking, order theory, ordinal data, and graded posets. While the notion of a grade in order theory is quite general, in some sense the way we ...
- 6,988
0
votes
0
answers
19
views
Rank ordered logit model based on large numbers of items
Say I have a set of 50 sweets of 5 different types, and a child makes a choice from all those available to pick and eat one. They repeat this until none are left. I give the same set of choices to 30 ...
- 467
0
votes
0
answers
13
views
Is there a non-parametric measure of correlation based on the logic of Kendall's tau but consider the magnitude of values?
I have a set of data that is rated by group of participants, the data is like this:
$i_1$
$i_2$
$i_3$
$p_1$
5
3
2
$p_2$
5
2
4
Where $I=\{i_1,i_2,\cdots,i_n\}$ is the items to rate, while $P=\{p_1,...
- 1
0
votes
0
answers
49
views
Why are ranking loss functions hard to optimize?
Currently I am learning about ranking loss functions, in particular the normalized cumulative gain, which can be written as:
$NDCG = \frac{DCG}{IDCG}$
where DCG is defined as
$DCG = \sum_{i=1}^N \frac{...
- 505
0
votes
0
answers
19
views
How do I measure (prey) preference while accounting for background rates?
I'm interested in looking whether dolphins have a preference for specific fish species caught in fishing nets.
So I have observed rates of bite marks on the fish which I use as a measure of preference....
- 901
1
vote
1
answer
36
views
Expected value of the max of scaled powers of the same random variable
I've been looking at order statistics and the behavior of expectations when max is involved, but that literature always discussed iid random variables whereas I have a strange situation where I have ...
- 285
0
votes
1
answer
70
views
How to compare different ratings of different products by different customers
I have ratings of different products (a number, 1...10) by different customers in different countries.
Product X will get a high rating in country A. Product Y will get a medium rating in country B. ...
0
votes
0
answers
47
views
Random tree partition of ordered lists
In a standard random tree, the input is a dataset of $N$ observations $x_1, x_2, \dots, x_N$ and the algorithm partitions the data in such a way that observations with similar values are grouped ...
- 11
0
votes
0
answers
27
views
Ranking data using a weight system
I've collected data from 4 people (id) on their number of violations at work regarding (1) logistics, (2) doing ...
- 3,396
3
votes
2
answers
53
views
Statistical notation question: How do I represent sorting variables, individually and by each other, symbolically?
I'd like to write a formula for a correlation coefficient that involves sorting continuous observations, both within a variable and by another variable. For example, I'd like to say that $r$ is ...
- 336
0
votes
1
answer
14
views
Probability of correctly ordering two measurements
I am measuring two points x and y with some normally distributed noise associated with each point, and want to determine which is greater:
x_measured = Normal(x_mean, x_sd)
y_measured = Normal(y_mean, ...
- 1