The tag has no wiki summary.

learn more… | top users | synonyms

1
vote
0answers
27 views

What measurements or tests should I take for testing stability of patterns?

I have a dataset containing behaviours of users. Let's say we have 1000 users and 40 similar tasks. The tasks are similar but the difficulty level vary.To do a task, people can follow 10 patterns. ...
0
votes
0answers
51 views

What is a “subject” in ICC?

I have been working in R and have finally got some code working regarding intraclass correlation coefficients. In the output I get something called "subjects". I thought it was to do with the number ...
2
votes
1answer
291 views

How to compare repeatability (ICC) of different groups?

I have calculated the ICC values for two groups and would now like to compare the ICC values to determine if the groups differ in their repeatability. In the literature people have simply used t-tests ...
1
vote
1answer
83 views

Determine individual consistency from mixed model?

To investigate the difference between three tasks I tested 30 individuals on each of the three tasks and ran the linear model as follows: ...
1
vote
0answers
181 views

How to analyze intra-rater reliability with 31 raters who all rated 4 subjects twice

I'm trying to analyze the intra-rater reliability of an occupational therapy assessment. The assessment consists of 57 items, where some items are ratio data and some items are ordinal data. In my ...
0
votes
0answers
131 views

Calculation of within-run precision or repeatability

I am trying to figure out how to calculate the within-run precision or repeatability of a dataset all run one one day on the same instrument and under the same conditions. For example: I have done a ...
8
votes
5answers
445 views

How to assess repeatability of multivariate and method-specific outcomes?

Method "A" describes biological samples using multivariate "fingerprints" that consist of about 30 different variables. Different variables show different typical distribution and many of them closely ...
0
votes
1answer
400 views

The use of xtmixed with the quickicc command

I am attempting to do a icc using the quickicc command following the use of xtmixed. I'm attempting to check repeatability in a ...
2
votes
2answers
116 views

How to assess whether experimental measurements obtained from different technicians are biased?

Suppose I have a list of measurements from an experiment; for example, 34 31 55 18 19 22 44 48 23 . . . But I then learn that these experiments were conducted by two different technicians, so I ...
20
votes
1answer
1k views

Computing repeatability of effects from an lmer model

I just came across this paper, which describes how to compute the repeatability (a.k.a. reliability, a.k.a. intraclass correlation) of a measurement via mixed effects modelling. The R code would be: ...
3
votes
1answer
382 views

Confidence intervals for repeatability

I have calculated the repeatability of individuals' responses to a stimulus using the methodology of Lessells & Boag (1987) Auk 104:116, where repeatability r = among-groups variance component / ...