# Tagged Questions

The Intra-class Correlation Coefficient measures the degree to which a categorical variable accounts for variability in a continuous variable. It is often used to index the degree of clustering in a dataset.

13 views

17 views

### correlations vs absolute difference scores

I am descriptively exploring partner similarity/agreement on several variables using intraclass correlations and absolute difference scores. I am also comparing partner similarity across different ...
9 views

### Intraclass correlation, multiple items per person

I am evaluating inter-rater reliability for acoustic measurements (formant frequencies) for vowel sounds. Data description: Subjects are recorded speaking 28 words, 7 words (5 different words, 2 ...
55 views

### ICC for inter-rater and parallel forms reliability with binary data?

I have 3 raters which each rate every file in a randomized set of files three times. Each file is rated as either a 1 or 0. I was hoping to assess the inter- and intra- rater reliability for the ...
79 views

### Does zero correlation mean no causation? [duplicate]

If I demonstrated that there is no correlation between two random variables, does that mean that there is no cause and effect relation between them ?
10 views

### Compute interrater reliability having different subsets of students rated by different subsets of raters

I would like to compute inter-rater reliability for a set of continuous items, having different subsets students assessed by different subsets of raters (please, see the picture). I would like to ...
49 views

### Intraclass correlation coefficient: zero and negative

I am trying to calculate reliability between two raters for continuous data. The data is frequency of negative life events for each participant. My data looks like this: Dataset 1 rater 1: 0 0 0 0 0 ...
48 views

### Interpretation of ICC

I'm using intraclass correlation to measure the reproducibility of some bacterial abundance data. This can be thought of as a matrix where the rows are bacterial species, and the columns are ...
8 views

### Compute average pairwise correlation Y(X1) vs Y (X2) within many nonoverlapping intervals of variable X

I am pretty sure someone already solved this problem and shared the code. Could you please help to find it? I need to calculate the pairwise correlation for the values of a discrete function Y(X) ...
13 views

### Coherence matrices

I'm analyzing ECoG data that were recorded during a working memory task. There are 6 different subjects and they all have about 100 trials. Each subject has different electrode coverage (so not in the ...
49 views

### Metaanalysis - how big should be the ICC (Intracluster correlation coefficient)?

The background is a metaanalysis of cluster randomised clinical studies. The included studies report no ICC for final values, the chosen ICC for the calculations was 0,02. Similar studies in the same ...
51 views

### Intraclass correlation (ICC) single vs average measure?

I think I need help understanding single-measurement ICC and its difference to average-measurement ICC. Assume I have the following situation: I have a specific rater I am interested in. I want to ...
22 views

### Analysis and Processing of Time Series Data

My project requires me to accurately analyze several (15) financial time series data - Indicators. The data consist mostly of several variants of moving average and stochastic information (ie ...
43 views

### Can I use ICC and bland altman plot to study agreement of small data?

I have data set with small sample size, like 10 pairs of continuous data. I checked out kappa and percentage agreement, both seems not appropriate for agreement analysis. Can I stick to use ICC and ...
73 views

### Calculate p-value for difference between ICC values [duplicate]

I cannot seem to find an answer to the following problem: I am doing interreader correlation studies where I calculate ICC values. It is quite easy to do this in R, but how do I calculate a p-value to ...
28 views

### Find general correlation between function with itself and other input data

I've collected data for a function F = f(g(x)), for different function shapes g(x). The goal is to predict values of ...
104 views

### How do I calculate the confidence interval of an ICC?

Here's the output from my the summary of lmer function which I used to calculate the ICC. ...
12 views

### Active Arm vs Control Arm during ICC

I have 25 factors in my active arm and 15 factors in my control arm. While calculating the ICC should I split the dataset into two, 1) those containing only active arm and 2) containing only control ...
55 views

### statistical analysis of cell culture data

I would be grateful for some advice regarding the optimal approach to hypothesis testing in the following scenario: We have data from a cell culture experiment obtained as follows: We culture some ...
18 views

### How to test assumptions for Intra Class Correlation coefficients?

I want to calculate inter-rater reliability using Shrout & Fleiss' Model 2 (intra class correlation). The general model is: The authors mention different assumptions such as normally ...
160 views

### Could the intraclass correlation coefficient be negative? [duplicate]

I'm a little confused regarding the intraclass correlation coefficient I am now reading "Face to Face interviews " by loosveldt 2008 . He pointed out on page 218 that the intraclass correlation ...
50 views

### Standardization for correlated observations

I am interested in a paper by John Walsh (1947), which demonstrates the effect of intraclass correlation on significance testing. The full text is available here. In outlining a proof, Walsh states "...
83 views

### ICC in a multi level model with two random effects

My understanding is that intraclass correlation gives you an idea of how much variance your level two factor can explain in overall variance of the dependent variable. It is supposed to give an ...
40 views

### Intraclass correlation (reliability) for accelerometer data

I want to assess the reliability of accelerometer measurements for three days. For the calculation of the reliability I use a random-effect model (in R) to get the proportion of subject variance to ...
36 views

### Intraclass Correlation Coefficient for Ordinal Probit model with heterogenous variances

I have a hierarchical ordinal probit model (subjects within locations) with heterogeneous variances, modelled in JAGS, somewhat similar to: http://www.ncbi.nlm.nih.gov/pubmed/19520453. The model is a ...
16 views

### What is the effect of correlated data on hypothesis testing with a linear mixed model?

In 1987, Scariano & Davenport cautioned that non-independence of data had marked effects on hypothesis testing with an ANOVA model (Stephen M. Scariano and James M. Davenport The Effects of ...
218 views

### inter-(-intra) class correlation coefficient or intra-(inter-) concordance coefficient in python

My question is about how to calculate inter-(intra-) class correlation coefficient (ICC) or intra-(inter-) concordance coefficient (CCC), ideally in python. My dataset consists of several dozen ...
92 views

### Intraclass Correlation Coefficient (ICC) between null and full mixed effects model?

I have some questions according interpretation and comparison of the ICC between the null and full model of a binary logistic multi level model (fitted with the R-package ...
184 views

### How to compute intraclass correlation (ICC) for THREE-level negative binomial hierarchical model?

I'm using lme4 in R, and I have a model set up that uses a three-level hierarchy for a negative binomial regression. There is previously a question (How compute the Intra-Class Correlation for a ...
116 views

### Intraclass correlation with count data

I want to calculate the ICC between 3 different measurements where the dependent variable is a count. As far as I understood, if the data were normally distributed, I would use a repeated measures ...
14 views

### Growth in lme nonnested factors

In an experiment, subjects have been assigned to groups and groups have been assigned to experimental conditions (one factor with two levels). The subjects have been measured on a variable 4 times ...
15 views

### Rubric Interrater reliability study

I'm looking at the interrater reliability of a 6-criteria grading rubric used by an online college for graduate students. I have 10 mini-studies with all four professors grading the papers of 12 ...
9 views

### Evaluating the internal consistancy of multivariate judges

Consider the wine judging example: A competition is being run, where There are a number different types of wine, eg Chardonnay, Merlot, Shiraz etc. About 50 types of wine. for any particular class ...
366 views

### How compute the Intra-Class Correlation for a Negative Binomial Mixed Model in lme4

I have a negative binomial mixed model with counties nested within states. I've read that the formula for the ICC for a negative binomial model is: found here: http://www.ncbi.nlm.nih.gov/pmc/...
31 views

### Correct approach for computing interrater reliability

everybody. Can't find a strong answer to this "special case" elsewhere on the interwebs, so I'm hoping you can help. I want to computer interrater agreement (actually, in this case, inter-method ...
96 views

### Notation of Variance of Residuals in Multilevel Modeling

I am having some trouble to understand the notation of variance of residuals in multilevel modeling . In this paper "Sufficient Sample Sizes for Multilevel Modeling" , in p.87 below equation (3) , ...
128 views

### acceptable ICC for 6-point Likert scale

I have pairs of pictures of participants making facial expressions (240 pairs per participant, 11 participants). Two raters agreed on a criterion and rated each one of the pairs on a scale from 1 to ...
179 views

### Calculating ICC using random intercept and residual variances

I have seen many posts refer to the calculation of the ICC by utilizing the variance of the random intercept and the residual variance from a multilevel model. Does anyone have this formula handy?
176 views

### Interpretation of random-effects GLS regression (multilevel model, 2 levels, strictly hierarchical)

There are several values in this analysis that I wonder how to interpret, and whether they can be used to calculate some sort of effect size. Contextual information: level 1 trials in a test - level ...
117 views

### Intra-class correlation and ANOVA for multi-class classification?

I have trained and evaluated with leave-one-out cross-validation classifiers (SVM, logistic regression, deep belief network, gaussian naive bayes, k-nearest neighbour) on my dataset. My dataset ...
110 views

### The valid variance components to include in a generalizability theory model (anova) involving nesting? Are these correct interactions?

My question is about generalizability theory. A study by Bergeron, Floyd, McCormack, and Farmer (2008) is only adding to this confusion. Basically, in G-theory you want the first model you run to ...