The Intra-class Correlation Coefficient measures the degree to which a categorical variable accounts for variability in a continuous variable. It is often used to index the degree of clustering in a dataset.

learn more… | top users | synonyms (1)

0
votes
0answers
6 views

Intraclass correlation coefficient in Bayesian statistics

I need some references about intraclass correlation coefficient in Bayesian statistics and hypothesis testing. I already take a look in A. Gelman, J.B. Carlin, H.S. Stern and D.B. Rubin, Bayesian ...
0
votes
1answer
28 views

What to do with negative ICC values? Adjust the test or interpret it differently?

For my graduation thesis I am doing a study for the test-retest reliability of the tendon thickness of a particular muscle. So this study contains one rater and 70 subjects who have been tested at two ...
2
votes
1answer
25 views

Using a Fixed-Effects ANOVA to help decide whether to conduct a multilevel analysis

Heck et al (2013) write that Generally, the first step in a multilevel analysis is partitioning the variance (referred to as $\sigma^2$) in an outcome variable into its within- and ...
6
votes
2answers
57 views

ICC as expected correlation between two randomly drawn units that are in the same group

In multilevel modelling the intraclass correlation often gets calculated from a random-effects ANOVA $$ y_{ij} = \gamma_{00} + u_j + e_{ij} $$ where $u_j$ are the level-2 residuals and $e_{ij}$ are ...
0
votes
0answers
15 views

correlations vs absolute difference scores

I am descriptively exploring partner similarity/agreement on several variables using intraclass correlations and absolute difference scores. I am also comparing partner similarity across different ...
0
votes
0answers
7 views

Intraclass correlation, multiple items per person

I am evaluating inter-rater reliability for acoustic measurements (formant frequencies) for vowel sounds. Data description: Subjects are recorded speaking 28 words, 7 words (5 different words, 2 ...
0
votes
0answers
44 views

ICC for inter-rater and parallel forms reliability with binary data?

I have 3 raters which each rate every file in a randomized set of files three times. Each file is rated as either a 1 or 0. I was hoping to assess the inter- and intra- rater reliability for the ...
0
votes
2answers
75 views

Does zero correlation mean no causation? [duplicate]

If I demonstrated that there is no correlation between two random variables, does that mean that there is no cause and effect relation between them ?
0
votes
0answers
8 views

Compute interrater reliability having different subsets of students rated by different subsets of raters

I would like to compute inter-rater reliability for a set of continuous items, having different subsets students assessed by different subsets of raters (please, see the picture). I would like to ...
0
votes
1answer
34 views

Intraclass correlation coefficient: zero and negative

I am trying to calculate reliability between two raters for continuous data. The data is frequency of negative life events for each participant. My data looks like this: Dataset 1 rater 1: 0 0 0 0 0 ...
0
votes
0answers
35 views

Interpretation of ICC

I'm using intraclass correlation to measure the reproducibility of some bacterial abundance data. This can be thought of as a matrix where the rows are bacterial species, and the columns are ...
0
votes
0answers
5 views

Compute average pairwise correlation Y(X1) vs Y (X2) within many nonoverlapping intervals of variable X

I am pretty sure someone already solved this problem and shared the code. Could you please help to find it? I need to calculate the pairwise correlation for the values of a discrete function Y(X) ...
0
votes
0answers
13 views

Coherence matrices

I'm analyzing ECoG data that were recorded during a working memory task. There are 6 different subjects and they all have about 100 trials. Each subject has different electrode coverage (so not in the ...
1
vote
1answer
41 views

Metaanalysis - how big should be the ICC (Intracluster correlation coefficient)?

The background is a metaanalysis of cluster randomised clinical studies. The included studies report no ICC for final values, the chosen ICC for the calculations was 0,02. Similar studies in the same ...
0
votes
0answers
32 views

Intraclass correlation (ICC) single vs average measure?

I think I need help understanding single-measurement ICC and its difference to average-measurement ICC. Assume I have the following situation: I have a specific rater I am interested in. I want to ...
0
votes
0answers
22 views

Analysis and Processing of Time Series Data

My project requires me to accurately analyze several (15) financial time series data - Indicators. The data consist mostly of several variants of moving average and stochastic information (ie ...
1
vote
0answers
40 views

Can I use ICC and bland altman plot to study agreement of small data?

I have data set with small sample size, like 10 pairs of continuous data. I checked out kappa and percentage agreement, both seems not appropriate for agreement analysis. Can I stick to use ICC and ...
1
vote
0answers
71 views

Calculate p-value for difference between ICC values [duplicate]

I cannot seem to find an answer to the following problem: I am doing interreader correlation studies where I calculate ICC values. It is quite easy to do this in R, but how do I calculate a p-value to ...
2
votes
0answers
27 views

Find general correlation between function with itself and other input data

I've collected data for a function F = f(g(x)), for different function shapes g(x). The goal is to predict values of ...
1
vote
0answers
80 views

How do I calculate the confidence interval of an ICC?

Here's the output from my the summary of lmer function which I used to calculate the ICC. ...
0
votes
0answers
12 views

Active Arm vs Control Arm during ICC

I have 25 factors in my active arm and 15 factors in my control arm. While calculating the ICC should I split the dataset into two, 1) those containing only active arm and 2) containing only control ...
0
votes
1answer
43 views

statistical analysis of cell culture data

I would be grateful for some advice regarding the optimal approach to hypothesis testing in the following scenario: We have data from a cell culture experiment obtained as follows: We culture some ...
0
votes
0answers
17 views

How to test assumptions for Intra Class Correlation coefficients?

I want to calculate inter-rater reliability using Shrout & Fleiss' Model 2 (intra class correlation). The general model is: The authors mention different assumptions such as normally ...
3
votes
1answer
140 views

Could the intraclass correlation coefficient be negative? [duplicate]

I'm a little confused regarding the intraclass correlation coefficient I am now reading "Face to Face interviews " by loosveldt 2008 . He pointed out on page 218 that the intraclass correlation ...
2
votes
1answer
50 views

Standardization for correlated observations

I am interested in a paper by John Walsh (1947), which demonstrates the effect of intraclass correlation on significance testing. The full text is available here. In outlining a proof, Walsh states ...
1
vote
0answers
71 views

ICC in a multi level model with two random effects

My understanding is that intraclass correlation gives you an idea of how much variance your level two factor can explain in overall variance of the dependent variable. It is supposed to give an ...
0
votes
0answers
34 views

Intraclass correlation (reliability) for accelerometer data

I want to assess the reliability of accelerometer measurements for three days. For the calculation of the reliability I use a random-effect model (in R) to get the proportion of subject variance to ...
0
votes
0answers
36 views

Intraclass Correlation Coefficient for Ordinal Probit model with heterogenous variances

I have a hierarchical ordinal probit model (subjects within locations) with heterogeneous variances, modelled in JAGS, somewhat similar to: http://www.ncbi.nlm.nih.gov/pubmed/19520453. The model is a ...
1
vote
0answers
16 views

What is the effect of correlated data on hypothesis testing with a linear mixed model?

In 1987, Scariano & Davenport cautioned that non-independence of data had marked effects on hypothesis testing with an ANOVA model (Stephen M. Scariano and James M. Davenport The Effects of ...
0
votes
0answers
179 views

inter-(-intra) class correlation coefficient or intra-(inter-) concordance coefficient in python

My question is about how to calculate inter-(intra-) class correlation coefficient (ICC) or intra-(inter-) concordance coefficient (CCC), ideally in python. My dataset consists of several dozen ...
0
votes
0answers
75 views

Intraclass Correlation Coefficient (ICC) between null and full mixed effects model?

I have some questions according interpretation and comparison of the ICC between the null and full model of a binary logistic multi level model (fitted with the R-package ...
0
votes
0answers
165 views

How to compute intraclass correlation (ICC) for THREE-level negative binomial hierarchical model?

I'm using lme4 in R, and I have a model set up that uses a three-level hierarchy for a negative binomial regression. There is previously a question (How compute the Intra-Class Correlation for a ...
1
vote
1answer
96 views

Intraclass correlation with count data

I want to calculate the ICC between 3 different measurements where the dependent variable is a count. As far as I understood, if the data were normally distributed, I would use a repeated measures ...
0
votes
0answers
14 views

Growth in lme nonnested factors

In an experiment, subjects have been assigned to groups and groups have been assigned to experimental conditions (one factor with two levels). The subjects have been measured on a variable 4 times ...
0
votes
0answers
14 views

Rubric Interrater reliability study

I'm looking at the interrater reliability of a 6-criteria grading rubric used by an online college for graduate students. I have 10 mini-studies with all four professors grading the papers of 12 ...
0
votes
0answers
9 views

Evaluating the internal consistancy of multivariate judges

Consider the wine judging example: A competition is being run, where There are a number different types of wine, eg Chardonnay, Merlot, Shiraz etc. About 50 types of wine. for any particular class ...
2
votes
1answer
329 views

How compute the Intra-Class Correlation for a Negative Binomial Mixed Model in lme4

I have a negative binomial mixed model with counties nested within states. I've read that the formula for the ICC for a negative binomial model is: found here: ...
0
votes
1answer
29 views

Correct approach for computing interrater reliability

everybody. Can't find a strong answer to this "special case" elsewhere on the interwebs, so I'm hoping you can help. I want to computer interrater agreement (actually, in this case, inter-method ...
2
votes
1answer
96 views

Notation of Variance of Residuals in Multilevel Modeling

I am having some trouble to understand the notation of variance of residuals in multilevel modeling . In this paper "Sufficient Sample Sizes for Multilevel Modeling" , in p.87 below equation (3) , ...
1
vote
1answer
119 views

acceptable ICC for 6-point Likert scale

I have pairs of pictures of participants making facial expressions (240 pairs per participant, 11 participants). Two raters agreed on a criterion and rated each one of the pairs on a scale from 1 to ...
1
vote
1answer
157 views

Calculating ICC using random intercept and residual variances

I have seen many posts refer to the calculation of the ICC by utilizing the variance of the random intercept and the residual variance from a multilevel model. Does anyone have this formula handy?
0
votes
0answers
164 views

Interpretation of random-effects GLS regression (multilevel model, 2 levels, strictly hierarchical)

There are several values in this analysis that I wonder how to interpret, and whether they can be used to calculate some sort of effect size. Contextual information: level 1 trials in a test - level ...
0
votes
0answers
25 views

How do you show adequate inter-rater agreement?

I have data from 230 individuals from different companies, who rated their perceptions of their individual companies' organizational climates (four different scales ranging from 7 questions to 4 ...
2
votes
0answers
106 views

Intra-class correlation and ANOVA for multi-class classification?

I have trained and evaluated with leave-one-out cross-validation classifiers (SVM, logistic regression, deep belief network, gaussian naive bayes, k-nearest neighbour) on my dataset. My dataset ...
0
votes
0answers
21 views

ICC using one-way random model

I need to compute the ICC value on my data set. I have a set of videos rated by different raters; each rater rated 4 videos randomly chosen. So, I would like compute ICC by using one-way random model ...
4
votes
2answers
104 views

The valid variance components to include in a generalizability theory model (anova) involving nesting? Are these correct interactions?

My question is about generalizability theory. A study by Bergeron, Floyd, McCormack, and Farmer (2008) is only adding to this confusion. Basically, in G-theory you want the first model you run to ...
0
votes
0answers
172 views

Intraclass Correlations ICC1, ICC2, ICC3?

I am doing some research for my teacher training. I am looking at the agreement between student-assessment and teacher-assessment. Essentially there are 4 tasks. Students scored the task and I ...
0
votes
0answers
229 views

Interpreting summary of ICC results in R package “psych”

I have a dataframe "all.st.icc", where 27 subjects have measures of social behavior for each of 8 different years. First four rows of data are as follows: ...
1
vote
0answers
39 views

Two separate or a single mixed-effects model?

Lets say my data is exam results of students nested in schools and there are two kinds of schools: private and public ones. Now, what I am interested is the variance between private and public ...
1
vote
0answers
365 views

Intraclass Correlation Coefficient value range vs strength of association

I read on this site that ICC is a good measure of association(effect size) between nominal and interval data..and the significance test suggested was anova...My question is, given the association is ...