Skip to main content

Questions tagged [repeatability]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
11 views

Confidence interval Standar Error of the Mean

I´m doing a repeatability study with 10 subjects that repeat 4 measures. Calculate Standard Error of the Mean(SEm) = SD(4 measures)/Sq(4), for each subject. Example: 234 226 239 244 Mean= 238 SEm = 2....
mdscience's user avatar
0 votes
1 answer
18 views

Mean difference Confidence interval Repeated measures anova

I´m doing 4 repeated measures (T1, T2, T3 and T4) with each subject in the same conditions to calculate repeatability. I have 10 subjects. Could be correct to report posthoc mean differences 95% ...
mdscience's user avatar
0 votes
0 answers
11 views

Repeatability for more than 2 measures

I´m trying to calculate repeatability for 4 measures. I see that one of the measures to do this is coefficient of repeatability (CR). The problem is that CR is used in test-retest experiments, for 2 ...
mdscience's user avatar
0 votes
0 answers
33 views

Repeatability coefficient and Standard error of Measurement

The repeatability coefficient (CR) (Bland Altman) is used to report repeatability understood as the index that compares measurements with the same subject, the same observer and in a short space of ...
mdscience's user avatar
0 votes
0 answers
10 views

Validity, reliability and repeatability

I want to validate an anemometer in a wind tunnel VS gold standard. Thinking in validity, reliability and repeatability. The dependent variable is wind speed. I can test 3 different units of the same ...
mdscience's user avatar
2 votes
0 answers
22 views

Identify the distribution of data [closed]

I did one experiment two times with the same subject. I want to find the repeatability of my result. repeatability in a sense is the fraction of behavioural variation that is due to differences ...
VINITHA M S's user avatar
1 vote
0 answers
103 views

Explanation needed for different ways of calculating precision (ISO-5725 and CLSI EP05-A2)

I'm trying to get along with calculating precision of analytical method. I'm a chemist not a mathematician. ICH M10 guideline requires that: Accuracy and precision should be determined by analysing ...
Radek Jaźwiec's user avatar
0 votes
0 answers
25 views

Understanding varying mean and repeatability

A common introduction in varying parameters looks like that $y_{ij} = \alpha_{j} + \epsilon_{ij}$, with $\epsilon_{ij} \sim\ N(0, \sigma^2_y)$ $\alpha_{j} = \mu_a + u_j $ and $ u_j \sim\ N(0, \sigma^...
Lefty's user avatar
  • 479
1 vote
1 answer
42 views

How to measure reproducibility for repeated measures

I have run an experiment where in a series of trials, each of 10 animals was presented with each of 6 stimuli, and each stimulus was offered once to the left and once to the right nostril. Overall, ...
Aga's user avatar
  • 11
4 votes
1 answer
80 views

What is the current status of Killeen’s probability of replication?

Killeen (1) published several papers about P-rep. It can be easily computed from a p-value (for a two-group comparison) and has an easy interpretation. It is the estimated probability that future ...
Harvey Motulsky's user avatar
1 vote
0 answers
59 views

What is Nakagawa repeatability measure quantifying?

I have been reading about repeatability estimation, and ICC and I am a little confused about how the quantity is being reported given its computation. From Stoffel et al 2017, repeatability, $R$, is ...
Constantin's user avatar
0 votes
0 answers
57 views

Investigating the existence of plasticity (random intercept model vs. random slope model) in a response variable that is not normally distributed

I wanted to explore if the change in speed between day and night is similar among a set of individuals. To me, the logic way of testing this hypothesis is running a random intercept model and a random ...
David VR's user avatar
  • 125
0 votes
1 answer
78 views

Gauge R&R analysis - Preicision of a system

I never attempted to do a GR&R analysis before so I'm sharing an overview of what I would like to attempt to do and hopefully I would get some insight/advice/reference on which approach I should ...
the phoenix's user avatar
1 vote
0 answers
40 views

I need help choosing a statistical method for my problem

I have 12 tools from different labs that are similar to each other. They measure two different parameters (green intensity and red intensity). I have 4 samples that will be measured 3 times each by ...
Sofia Jin's user avatar
1 vote
1 answer
196 views

Why not using confidence interval to calculate the repeatability?

When calculating the repeatability, like when you want to know how good the measurement of the length of a ruler is, I often read that it is sufficient to calculate the standard deviation. I wonder ...
Ben's user avatar
  • 3,473
1 vote
0 answers
117 views

Correlation vs Standardized repeatability

Update: I reworded my question as I felt I didn't clearly state the root of the issue and inflated my question with too much irrelevant information. Repeatability and correlation are linked. ...
R. Iersel's user avatar
1 vote
0 answers
334 views

How is it possible to control for observer bias in measurements with a random effect?

I have a dataset with repeated (but not always) measures of animals. I need to control for observer bias in measuring the morphology of my animal. I'm wondering what is the way to first estimate ...
M. Beausoleil's user avatar
0 votes
0 answers
36 views

Method to estimate effects of covariates on the repeatability of a test

I am fairly new to statistics and hoping someone can provide some advice on some analysis I'd like to do. I am looking to analyse the effects of covariates on the repeatability/variability of a ...
S.Strike's user avatar
1 vote
1 answer
178 views

What statistic to use to assess repeatability of measurement [closed]

I want to assess the repeatability of a measurement device. Let's say I have made three measurement with the same device under the same conditions. What statistic is useful for assessing the ...
H321's user avatar
  • 11
0 votes
1 answer
127 views

Repeatability of measurement technique

I'm measuring a person's heart rate based on their position (gradually from laying down to standing up): I tried 8 positions. Now, I recorded the heart rate of 15 people and I measured them twice. ...
user163289's user avatar
5 votes
0 answers
85 views

Given $p=0.05$ in one study, what is the likelihood of $p \ge 0.05$ in a repeated study? [duplicate]

This question comes from a discussion on reddit. One user asked a question: Given $p=0.05$ in one study, what is the likelihood of $p \ge 0.05$ if the same study was repeated under the exact same ...
Karolis Koncevičius's user avatar
0 votes
0 answers
48 views

Increasing sensor resolution by repeat measurement

I have a thermometer which has resolution of 1C. The temperature is measured, the thermometer is reset, and the temperature is measured again. I'm looking for a formula to calculate how many ...
Arsen Zahray's user avatar
4 votes
2 answers
8k views

Completely different results after each cross validation

I'm running some classification algorithms in MATLAB and validating them with a 10-fold cross validation. The problem is that every time I execute the cross validation, it gives a very different ...
Alb_a's user avatar
  • 155
6 votes
1 answer
404 views

Statistical significance, repeatability, and sample size (50 shades of grey)

Reading about the problems with significance I wondered how one would approach an experiment in the right way, considering that in practice the sample size cannot be arbitrarily large. While some ...
Stefan's user avatar
  • 61
0 votes
1 answer
751 views

Assessing Repeatability of a Multivariate Measurement

I have a measurement that was taken 10 times on a sample. The measurement has roughly 11K points. If you're curious, I'm looking at mass spectrum data. I want to determine the repeatability of the ...
GK89's user avatar
  • 264
2 votes
1 answer
2k views

Repeatability estimation using a mixed model with repeated measures by four raters

I am a medical doctor and definitely not an expert in statistics, although I think I do okay and I am familiar with R. I have discussed the following issue with a statistician but I am still not sure ...
Dennis's user avatar
  • 21
1 vote
1 answer
473 views

Confidence interval for Repeatability from a lme mixed model

I have a (lme) mixed model of this type: ...
David VR's user avatar
  • 125
1 vote
1 answer
463 views

Intra-rater reliability for categorical (non-binary) data with variable observations

Here's what my data look like: From a mark-recapture study on a population of birds, I have data on the coloration score for each individual bird. The coloration score is a simple visual score that ...
Cody Porter's user avatar
1 vote
1 answer
1k views

Computing repeatability from overdispersed zero-inflated negative binomial GLMMM in R

I'm trying to compute repeatability of a count response variable from a Generalized linear mixed model with multiple fixed effects and individual ID as a random effect. I'm dealing with both ...
Justin Strong's user avatar
1 vote
0 answers
49 views

What measurements or tests should I take for testing stability of patterns?

I have a dataset containing behaviours of users. Let's say we have 1000 users and 40 similar tasks. The tasks are similar but the difficulty level vary.To do a task, people can follow 10 patterns. ...
nan's user avatar
  • 1,135
10 votes
1 answer
9k views

How to compare repeatability (ICC) of different groups?

I have calculated the ICC values for two groups and would now like to compare the ICC values to determine if the groups differ in their repeatability. In the literature people have simply used t-tests ...
crazjo's user avatar
  • 838
2 votes
1 answer
392 views

Determine individual consistency from mixed model?

To investigate the difference between three tasks I tested 30 individuals on each of the three tasks and ran the linear model as follows: ...
crazjo's user avatar
  • 838
2 votes
0 answers
1k views

How to analyze intra-rater reliability with 31 raters who all rated 4 subjects twice

I'm trying to analyze the intra-rater reliability of an occupational therapy assessment. The assessment consists of 57 items, where some items are ratio data and some items are ordinal data. In my ...
Bianca van Keulen's user avatar
10 votes
5 answers
973 views

How to assess repeatability of multivariate and method-specific outcomes?

Method "A" describes biological samples using multivariate "fingerprints" that consist of about 30 different variables. Different variables show different typical distribution and ...
David D's user avatar
  • 727
0 votes
2 answers
730 views

The use of xtmixed with the quickicc command

I am attempting to do a icc using the quickicc command following the use of xtmixed. I'm attempting to check repeatability in a ...
Erik's user avatar
  • 1
4 votes
2 answers
211 views

How to assess whether experimental measurements obtained from different technicians are biased?

Suppose I have a list of measurements from an experiment; for example, 34 31 55 18 19 22 44 48 23 . . . But I then learn that these experiments were conducted by two different technicians, so I ...
Fixee's user avatar
  • 635
31 votes
1 answer
5k views

Computing repeatability of effects from an lmer model

I just came across this paper, which describes how to compute the repeatability (a.k.a. reliability, a.k.a. intraclass correlation) of a measurement via mixed effects modelling. The R code would be: <...
Mike Lawrence's user avatar
4 votes
1 answer
1k views

Confidence intervals for repeatability

I have calculated the repeatability of individuals' responses to a stimulus using the methodology of Lessells & Boag (1987) Auk 104:116, where repeatability r = among-groups variance component / (...
Freya Harrison's user avatar