Interpreting the random effect in a mixed-effect model

Question

I am looking at several dependant variables for which I created LMMs of the following kind:

DV ~ Group + (1|Subject) + (1|Time)

Now I am struggling with how to interpret the output concerning the random effects, e.g. for DV1:

Random effects:
 Groups   Name        Variance Std.Dev.
 Subject   (Intercept)  6.2     2.49    
 Time      (Intercept) 67.7     8.23    
 Residual             50.2     7.08    

and for DV2:

 Groups   Name        Variance Std.Dev.
 Subject   (Intercept)  27.2     5.22   
 Time      (Intercept)  17.7     4.21   
 Residual             125.2    11.19   

Are conclusions such as the following valid?

1. Variability between subjects was about twice as high for DV2 than DV1.
2. Variability between dates (time) was higher for DV1 than DV2.
3. For DV1 time accounted for a higher variability than subject
4. For DV2 a similar amount of variability can be attributed to time and subject.
5. For DV1 there was a variability of about 8 [units] between years.
6. For DV2 variability between subjects was about 5 [units].

Thanks!

Answer 1

I'd suggest centering the interpretation around intraclass correlations:

1. For DV1, the total random variation not explained by the group differences (the fixed factor) is $\hat\sigma^2_{tot} = 6.2 + 67.7 + 50.2 = 124.1$, so that the total SD is $\hat\sigma_{tot}=11.14$. For DV2, these figures are $\hat\sigma^2_{tot} = 170.1$ and $\hat\sigma_{tot}=13.04$
2. For DV1, the correlation between two observations on the same subject but different times is $r_S = 6.2/124.1=.050$, while for DV2 it is $27.2/170.1 = .160$
3. For DV1, the correlation between two observations at the same time but different subjects is $r_T = 67.7/124.1=.546$, while for DV2 it is $17.7/170.1=.104$
4. For DV1, the correlation between two observations on the same subject and the same time is $r_{ST} = (6.2 + 67.7)/124.1 = 1-50.2/124.1=.595$, while for DV2 it is $1-125.2/170.1=.264$

Of course, point (4) may or may not be meaningful in your experiment. The largest correlation, by far is the Time one for DV1: Time effects contribute hugely to the variations in DV1.

I agree with ahfoss on avoiding the word "variability"

A bit more on intraclass correlation

Most experimental design books discuss this topic under "model II" or "random-effects models". Suppose that a measurement $Y$ follows $Y = \mu + S + E$ where $S$ is random variation among subjects and $E$ is error variance. Then $Var(Y) = Var(S)+Var(E) = \sigma^2_S + \sigma^2_E$. Now let $Y_1$ and $Y_2$ be two such measurements. Then in general, $$Var(Y_1-Y_2)=Var(Y_1)+Var(Y_2)-2Cov(Y_1,Y_2) = 2(\sigma^2_S+\sigma^2_E)-2Cov(Y_1,Y_2)$$ If the measurements are on the same subject, then the $S$ term cancels out and we have $$Var(Y_1-Y_2)=2\sigma^2_E$$ Equating these, we have $$Cov(Y_1,Y_2) = (\sigma^2_S+\sigma^2_E) - \sigma^2_E = \sigma^2_S$$ and thus that $Corr(Y_1,Y_2) = \sigma^2_S / (\sigma^2_S+\sigma^2_E)$.

This is called the intraclass correlation because it is the correlation of two measurements in the same class. It is useful because having random effects in a model implies a correlation structure in the data, and this quantifies it. The above ideas apply when there are more random effects; you just add the variances of the random effects you are conditioning upon.

Answer 2

A few things. First, be careful with the general term "variability." In a general context it is fine, but if you are referring to variance or standard deviation specifically, use the correct term. Also, as per my comment to your statement, remember that these are variances of the distributions of subject- and time-specific intercepts.

Your statements (1) and (2) are not valid. If your goal in this analysis is to make an inference about absolute differences in variances between two variables with respect to a grouping, you would need some formal hypothesis test, which you have not implemented. You can make relative statements, however. You might modify (1) as "between-subject variability accounted for a greater proportion of the variance in DV2 compared to DV1"

Modify your remaining statements like this:

(3) Time accounted for a larger proportion of the variance in DV1 than subject

(4) modify as in (3), but how you define "similar" should be carefully considered based on your goals. In some contexts, a difference of 1 might be very meaningful...

(5) For DV1, time-specific means were drawn from a normal distribution with standard deviation 8 (assuming you have checked that normality assumptions hold, approximately)