Questions tagged [rating]

"A rating is the evaluation or assessment of something, in terms of quality (as with a critic rating a novel), quantity (as with an athlete being rated by his or her statistics), or some combination of both" (Wikipedia).

Filter by
Sorted by
Tagged with
1
vote
0answers
14 views

Finding rating for individual based on multiple raters

I am trying to find an individual agent's score based on customer scores (raters) while the customer only rates their overall experience. Context The customer enters a shop and meets a service agent ...
0
votes
0answers
35 views

How to use statistics for better ratings [closed]

I do linguistic rating of thousands of words on over 30 criteria. For each criteria I came up with different ways of rating: -0,25 for each occurrence 0 or 2 -1 to +1 -1 to +2 1 for each occurrence ...
0
votes
0answers
19 views

Using Ordinal (Star Rating) variables to predict outcomes in Log lin regressions + Taking Median significant coefficients of multiple regressions

Framing the regression I am attempting to analyze the effects of several variables on clicks for Google My Business listings. Currently I'm using a Log-Lin regression model to predict the % increase ...
0
votes
0answers
11 views

Estimating probability from regression utility equation

I collected my data for a type of delivery service having two attributes: wait time (less than 15 minutes, 15 to 30 minutes, 30 to 45 minutes, and more than 45 minutes) and price (less that 5 minutes,...
0
votes
0answers
10 views

Adjusting existing ranking system to Elo based ranking system

I am looking into adapting an existing ranking system into an elo based ranking system. Elo rating is a method for calculating the relative skill levels of players in zero-sum games. The difference ...
2
votes
0answers
10 views

Baysian estimators for adjusting mean for n [closed]

If I would like to adjust my mean by $n$, I come across these 2 questions (1, 2), which both seem to suggest a Bayesian estimator to solve this problem. Yet both seem to have different approaches. ...
0
votes
0answers
29 views

sample size calculation for intraclass correlation coefficient (ICC)

I want to design a study when I'll be comparing three measurements of a variable in imaging and then compute an ICC as a measure of agreement since I'll be obtain a continuous measurement. I read ...
1
vote
1answer
11 views

Principled Method for Reweighting Labels Based on Labeler Consistency?

I have a large dataset where each datum has been labeled by multiple raters, and each rater has labeled multiple datums. Rather than assigning to each datum the naive average of all of the labels ...
0
votes
0answers
11 views

Compare ratings of players over different leagues?

I want to compare ratings of players from different leagues and predict rating of player in a league he/she didn't participate in. Rating of a player is estimated within a league where he was playing. ...
0
votes
1answer
42 views

Is there a statistical measure that combines difference in means and dispersion?

I am working on an academic physics problem, where I am trying to determine favourable variables in two data sets, where both data sets have the same variables. The most favourable variables would ...
0
votes
1answer
50 views

Ordinal Logistic Regression or mixed-model ANOVA?

My experiment is a 2x2x2 mixed design, with one between-subjects factor and the other 2 IVs as within-subjects factors. All variables have two levels. My DV comes in the form of profundity rating ...
0
votes
0answers
14 views

Intuition for Glicko rating periods

From the Glicko specification: The Glicko system works best when the number of games in a rating period is moderate, say an average of 5-10 games per player in a rating period What's the ...
1
vote
1answer
103 views

Statistical test for preference data through average differences or is other method more suitable?

I need your help. I'm designing a questionary and there I want test which version the people prefere. Which of the following methods is better and which statistical test for significance in each ...
0
votes
0answers
15 views

Good model for the interplay of reviews and revenue for AirBnB rental?

I am looking at the interaction effect of the 5 star rating on AirBnB revenue for my AirBnB (I have the complete time series of bookings and reviews for the property). I want to get the marginal ...
1
vote
1answer
83 views

What are the Elo formulas when assuming performance to be logistically distributed?

I'm struggling to find a definite source on the Elo rating system but from what I understand: it originally assumes players performance to be normally distributed with $\sigma = 1$ the expected ...
1
vote
1answer
31 views

How to put a collection of random variables in order?

I have a collection of independent Gaussian random variables with unknown means and variances. I want to order them in the order of increasing mean value. For this, I want to come up with a score ...
0
votes
1answer
44 views

How would I calculate value with negative numbers?

I have a dataset of basketball player salaries and an estimation of how many wins they contributed to their teams over the season. So a reasonable thing to do with those numbers would be to divide the ...
1
vote
1answer
18 views

Is Using Differnet Evaluators for Head-to-Head Competing Grants a Fair Process?

We evaluate around 100 grant proposals each year using a team of 15 evaluators who all use the same criteria. 100 grant proposals is a lot for any one evaluator to do and they are experiencing ...
1
vote
2answers
77 views

Developing a simple scoring system for client performance

I was hoping someone can point me in the right direction to develop a simple scoring system or algorithm on clients revenue performance over a period of time. I have over 400 clients with their ...
1
vote
0answers
43 views

What is the best method to rank elements with multiple attributes

This is Kumar, the fire beast monk. The left numbers are the base stats, the green numbers are the stats provided by the equip runes. Depending on your runes you can make your monster more stronger. ...
1
vote
0answers
57 views

Ranking on a 3 point scale

Apologies in advance, my background is in CS rather than statistics, so I may use some terms improperly. I have a data set of a few thousand items scored on a 3 point scale, which my research ...
0
votes
0answers
20 views

Build customer ratings from subscription datetime data for a recommendation system

I want to build a recommendation system with only some customer's subscription and unsubscription date. I have a database that looks like: ...
2
votes
0answers
12 views

Should reviews/ratings data be considered as repeated measures?

Suppose I have some ratings/review data for a type of product (say coffee). There are many different kinds of coffee and there are many different subjects reviewing coffee and also some covariates ...
1
vote
0answers
97 views

How to correlate movie taste?

I am looking for the best known way to correlate movie taste, i.e. to determine which people out of a large pool deviate the least from your own movie scores. One site with this purpose is Criticker. ...
0
votes
1answer
34 views

What model should I use?

I was having a discussion with my father about building an index that ranks cities as a function of multiple variables. For example, ranking n=20 cities based on $$$/SQFT and air quality. I would ...
0
votes
1answer
129 views

How to better rank based on ratings that takes the number of reviews into account?

Normally on most websites when items are being ranked based on reviews, they’re simply based on the average rating (out of 5 or 10); however, I believe an item that has an average rating of 4 based on ...
2
votes
0answers
37 views

What is the name of this test for the probability of differences between lists and is it valid?

And are there any better methods? In a 1969 book about investing, the author Burton P. Fabricand describes a method for assessing the effectiveness of a stock picker. Ask the picker to provide a list ...
0
votes
2answers
41 views

Turning a player's points value into a 1-10 match rating scale? [closed]

So I have the players "fantasy score" stat. This stat is the sum of their ingame stats multiplied by preset weights. These weights are from the video game DOTA 2's official fantasy points weights. For ...
7
votes
2answers
100 views

Elo-type ranking system that incorporates game score

The Elo rating system is used to calculate relative skill levels between individuals or teams. It can be applied to many types of games and sports, but when applied, it only considers wins and losses. ...
0
votes
1answer
267 views

comparing bipolar scale to unipolar scale

I'm trying to build some surveys and I want to ask the following questions: After 3 weeks, how do you feel about decision to join our company? Very Dissatisfied Moderately Dissatisfied Slightly ...
2
votes
1answer
101 views

best-worst ranking: do all items have to be blocked together at least 1 time?

Here there are instructions to build Max-diff (or Best-worst) ranking questionnaire: In an ideal world, a MaxDiff experimental design has the following characteristics, where each alternative appears:...
2
votes
1answer
149 views

How to decide the number of options to give to people in a poll? (for opinion based, subjective contexts)

Just to be clear, this question is open ended on purpose, I am fine with(or even prefer to) being pointed to a few research papers, and proper areas related to this subject. I am not sure what I am ...
0
votes
1answer
48 views

Averaging bang for the buck

I'm building a table/graph to compare multiple video cards according to a given benchmark. The benchmark consists of multiple measurements using games. For each benchmark measurement, I build a ...
1
vote
1answer
87 views

Which rating variable is affecting the main rating?

I have 3 types of rating, the restaurant rating (main rating), food rating, and service rating. Each of these ratings go from 0 to 2. I would like to know if it's possible to tell if a restaurant is ...
2
votes
0answers
73 views

Considering sample size when comparing average ratings

Consider, for example, an online shop listing multiple products available for purchase. Each product has an average rating from 1 to 5 calculated from all that product's customer ratings to date. To ...
7
votes
2answers
649 views

General principles for extending the Elo system to games in which the margin of victory matters

Note I am a first-time user of this site, and am not sure what determines how broad a question is. I consciously limited the question to general principles in order to avoid making it too broad (by ...
3
votes
1answer
254 views

Does Elo rating system address isolated groups of players?

I am looking to apply a flavor of the Elo Rating System to a game that is played all over the world (not chess) and am toying with the idea of adding what I might consider an "enhancement" to it. So ...
1
vote
1answer
62 views

One sample test for helpfulness ratings

I have some questionnaire data were participants rated with [0, 1, 2, 3, 4] whether a product helped with respect to several attributes. 0 indicates that it didn't help at all and 4 is very much. I ...
0
votes
1answer
29 views

Magnifying the outliers in a rating system to rank objects better

1) I am trying to design a product for weekly ratings (1-5) of an entity. The entity's rating will be reset every year. I know most of the weeks the rating will be the same (3) and I want a way to ...
2
votes
1answer
38 views

Are average online ratings of products (say out of 5) assumed to be on a linear scale as understood by the user?

Suppose 2 washing machines A & B are rated as 3.5 and 4.0 (out of 5) respectively, vs another 2, C & D, that are rated as 4.2 and 4.7 respectively. Can I make some useful inference based on ...
2
votes
1answer
121 views

How much information is gained when sampling from a random distribution?

This is a problem I have encountered while considering ELO ratings for a game like Go. Suppose we have two players, one has a known rating, the other's is unknown but assumed to be close to the first....
2
votes
0answers
56 views

How can I rate the predictive power of a function through a heatmap?

Context: I use a certain function that is supposed to estimate the possibility of an event "B" to occur in a given area, following the occurence of event "A". The input is a map of the area, and the ...
0
votes
0answers
31 views

Finding an estimate of value from rated examples

Given a sample of items with known monetary values, say 10 cars, and a person rating each car in turn as being more or less valuable than their own, what would be the best way of estimating the value ...
1
vote
0answers
29 views

Determining rating function for severity measure

I have data of a medical experiment and want to run a linear regression. More precisely, I have severity degrees of a disease of two independent groups (treatment and control group). The severity ...
0
votes
1answer
5k views

How to normalize rating in scale of 1 to 5?

Can anyone please tell me How to normalize rating in a scale of 1 to 5? In Yahoo! Movies dataset user has given a rating to a movie on the scale of 1 to 13 and 0 means there is no rating to that ...
0
votes
0answers
90 views

Ranking, rating things based on a set of metrics

I need to rank a set of things belonging to different kind (models) based on a list of performance metrics. For thing of each model, I have the aggregated value ( mean) of let's say 4 metrics and ...
2
votes
0answers
992 views

Recommender Systems with Implicit Feedback Data - Modelling and Updating

I have a very large dataset of user-item interactions. It tells me how many times a user bought, viewed or liked an item - all these actions are in binary form and I don't have any explicit ratings. ...
0
votes
1answer
46 views

Attributing difference in a DV (preference rating) to between-subjects manipulation vs preference differences

Say we want to test which of two products A and B is more liked by the general public, by obtaining ratings from random participants assigned to groups A and B, i.e. a between-subjects design. Let's ...
3
votes
2answers
149 views

Error bars (or their likeness) for rankings

This is a bit of a simple question I would suspect for many users here, but for someone like me who has never covered this in my statistics classes, this is posing a bit of a problem. I want to ...
-1
votes
1answer
125 views

Choosing method for multiple linear regression for 1 to 10 ratings

I'm performing a survey where people will rate some things from 1 to 10 based on their characteristics and I'm having trouble understanding which model to use and how to compile the data. For ...