Questions tagged [repeatability]

The tag has no usage guidance.

24 questions
46 views

How is it possible to control for observer bias in measurements with a random effect?

I have a dataset with repeated (but not always) measures of animals. I need to control for observer bias in measuring the morphology of my animal. I'm wondering what is the way to first estimate ...
14 views

Which ICC (ICC(2,1) or ICC(2,k)) should I report?

I have some hundred subjects indicating on a 7point scale for 10 situations how likely they are to be influenced in diverse situations. I will build an index of the responses for these behaviors and ...
22 views

Method to estimate effects of covariates on the repeatability of a test

I am fairly new to statistics and hoping someone can provide some advice on some analysis I'd like to do. I am looking to analyse the effects of covariates on the repeatability/variability of a ...
59 views

Calculating Repeatability by MCMCglmm

I'm trying to calculate repeatability of aggression (ordinal scores ranging from 1 to 6) of individuals. Individuals (ID) are not independent, but are nested within colonies. We know that colonies ...
52 views

What statistic to use to assess repeatability of measurement [closed]

I want to assess the repeatability of a measurement device. Let's say I have made three measurement with the same device under the same conditions. What statistic is useful for assessing the ...
61 views

Repeatability of measurement technique

I'm measuring a person's heart rate based on their position (gradually from laying down to standing up): I tried 8 positions. Now, I recorded the heart rate of 15 people and I measured them twice. ...
57 views

Given $p=0.05$ in one study, what is the likelihood of $p \ge 0.05$ in a repeated study? [duplicate]

This question comes from a discussion on reddit. One user asked a question: Given $p=0.05$ in one study, what is the likelihood of $p \ge 0.05$ if the same study was repeated under the exact same ...
18 views

Increasing sensor resolution by repeat measurement

I have a thermometer which has resolution of 1C. The temperature is measured, the thermometer is reset, and the temperature is measured again. I'm looking for a formula to calculate how many ...
3k views

Completely different results after each cross validation

I'm running some classification algorithms in MATLAB and validating them with a 10-fold cross validation. The problem is that every time I execute the cross validation, it gives a very different ...
265 views

Statistical significance, repeatability, and sample size (50 shades of grey)

Reading about the problems with significance I wondered how one would approach an experiment in the right way, considering that in practice the sample size cannot be arbitrarily large. While some ...
659 views

Assessing Repeatability of a Multivariate Measurement

I have a measurement that was taken 10 times on a sample. The measurement has roughly 11K points. If you're curious, I'm looking at mass spectrum data. I want to determine the repeatability of the ...
981 views

Repeatability estimation using a mixed model with repeated measures by four raters

I am a medical doctor and definitely not an expert in statistics, although I think I do okay and I am familiar with R. I have discussed the following issue with a statistician but I am still not sure ...
214 views

Confidence interval for Repeatability from a lme mixed model

I have a (lme) mixed model of this type: ...
177 views

Intra-rater reliability for categorical (non-binary) data with variable observations

Here's what my data look like: From a mark-recapture study on a population of birds, I have data on the coloration score for each individual bird. The coloration score is a simple visual score that ...
684 views

Computing repeatability from overdispersed zero-inflated negative binomial GLMMM in R

I'm trying to compute repeatability of a count response variable from a Generalized linear mixed model with multiple fixed effects and individual ID as a random effect. I'm dealing with both ...
44 views

What measurements or tests should I take for testing stability of patterns?

I have a dataset containing behaviours of users. Let's say we have 1000 users and 40 similar tasks. The tasks are similar but the difficulty level vary.To do a task, people can follow 10 patterns. ...
6k views

How to compare repeatability (ICC) of different groups?

I have calculated the ICC values for two groups and would now like to compare the ICC values to determine if the groups differ in their repeatability. In the literature people have simply used t-tests ...
271 views

Determine individual consistency from mixed model?

To investigate the difference between three tasks I tested 30 individuals on each of the three tasks and ran the linear model as follows: ...
1k views

How to analyze intra-rater reliability with 31 raters who all rated 4 subjects twice

I'm trying to analyze the intra-rater reliability of an occupational therapy assessment. The assessment consists of 57 items, where some items are ratio data and some items are ordinal data. In my ...
699 views

How to assess repeatability of multivariate and method-specific outcomes?

Method "A" describes biological samples using multivariate "fingerprints" that consist of about 30 different variables. Different variables show different typical distribution and many of them closely ...
664 views

The use of xtmixed with the quickicc command

I am attempting to do a icc using the quickicc command following the use of xtmixed. I'm attempting to check repeatability in a ...
168 views

How to assess whether experimental measurements obtained from different technicians are biased?

Suppose I have a list of measurements from an experiment; for example, 34 31 55 18 19 22 44 48 23 . . . But I then learn that these experiments were conducted by two different technicians, so I ...