40
$\begingroup$

I hope you all don't mind this question, but I need help interpreting output for a linear mixed effects model output I've been trying to learn to do in R. I am new to longitudinal data analysis and linear mixed effects regression. I have a model I fitted with weeks as the time predictor, and score on an employment course as my outcome. I modeled score with weeks (time) and several fixed effects, sex and race. My model includes random effects. I need help understanding what the variance and correlation means. The output is the following:

Random effects  
Group   Name    Variance  
EmpId intercept 680.236  
weeks           13.562  
Residual 774.256  

The correlaton is .231.

I can interpret the correlation as there is a a positive relationship between weeks and score but I want to be able to say it in terms of "23% of ...".

I really appreciate the help.


Thanks "guest" and Macro for replying. Sorry, for not replying, I was out at a conference and I’m now catching up. Here is the output and the context.

Here is the summary for the LMER model I ran.

>summary(LMER.EduA)  
Linear mixed model fit by maximum likelihood  
Formula: Score ~ Weeks + (1 + Weeks | EmpID)   
   Data: emp.LMER4 

  AIC     BIC   logLik   deviance   REMLdev   
 1815     1834  -732.6     1693    1685

Random effects:    
 Groups   Name       Variance Std.Dev. Corr  
 EmpID   (Intercept)  680.236  26.08133        
          Weeks         13.562 3.682662  0.231   
 Residual             774.256  27.82546        
Number of obs: 174, groups: EmpID, 18


Fixed effects:    
            Estimate Std. Error  t value  
(Intercept)  261.171      6.23     37.25    
Weeks          11.151      1.780    6.93

Correlation of Fixed Effects:  
     (Intr)  
Days -0.101

I don’t understand how to interpret the variance and residual for the random effects and explain it to someone else. I also don’t know how to interpret the correlation, other than it is positive which indicates that those with higher intercepts have higher slopes and those with those with lower intercepts have lower slopes but I don’t know how to explain the correlation in terms of 23% of . . . . (I don’t know how to finish the sentence or even if it makes sense to do so). This is a different type analysis for us as we (me) are trying to move into longitudinal analyses.

$\endgroup$
3
  • 1
    $\begingroup$ Zeda, it would be helpful to see more of the R output here, including the output's summary of the fixed effects $\endgroup$
    – guest
    Mar 10, 2012 at 21:35
  • 1
    $\begingroup$ One thing I can see is that the estimated intraclass correlation for EmpID is $\hat{\rho} = 680.236/(680.236+13.562+774.256)$. That is, the estimated correlation between two individuals in the same level of EmpID is $\hat{\rho}$. I agree with @guest that more output (and some context) would be helpful. $\endgroup$
    – Macro
    Mar 10, 2012 at 22:27
  • $\begingroup$ Zeda, I've converted your reply as an edit, and merged your two unregistered accounts. Please, register this one so that you can follow up and update your post yourself. $\endgroup$
    – chl
    Mar 19, 2012 at 15:30

1 Answer 1

47
$\begingroup$

Your fitted model with lme() can be expressed as

$y_{ij} = \alpha_0 + \alpha_1 x_j + \delta_{0i} + \delta_{1i} x_j + \epsilon_{ij}$

where $y_{ij}$ is the score of $i$th employee at $x_j$ weeks, $\alpha_0$ and $\alpha_1$ are the fixed intercept and slope respectively, $\delta_{0i}$ and $\delta_{1i}$ are the random intercept and slope, and $\epsilon_{ij}$ is the residual. The assumptions for the random effects $\delta_{0i}$, $\delta_{1i}$ and residual $\epsilon_{ij}$ are

$(\delta_{0i}, \delta_{1i})^T \stackrel{d}{\sim} N((0, 0)^T, G)$ and $\epsilon_{ij} \stackrel{d}{\sim} N(0, \sigma^2)$,

where the variance-covariance structure $G$ is a 2 x 2 symmetric matrix of form

$$\begin{pmatrix} g_1^2&g_{12}^2\\ g_{12}^2&g_2^2 \end{pmatrix}$$

You can get the variance matrix between random effects terms from VarCorr(LMER.EduA)$ID.

Your result basically says that

$\alpha_0$ = 261.171, $\alpha_1$ = 11.151,

$g_1^2$ = 680.236, $g_2^2$ = 13.562, and $\sigma^2$ = 774.256.

$g_{12}^2$ can be found in VarCorr(LMER.EduA) or calculated as $0.23\times \sqrt{g_1^2 g_2^2}$.

Specifically $g_1^2$ = 680.236 shows the variability of the intercept across employees, $g_2^2$ = 13.562 is the amount of variability in the slope across employees, and 0.231 indicates the positive correlation between intercept and slope (when an employee's intercept increases by one unit of standard deviation, that employee's slope would increase by 0.231 standard deviations).

$\endgroup$
4
  • 3
    $\begingroup$ Please check that recent edits didn't alter the meaning of your reply (Personally, I just fixed some $\LaTeX$ expressions). $\endgroup$
    – chl
    Mar 20, 2012 at 20:51
  • $\begingroup$ @chl: I really appreciate you for structuring my response in such a nice format (I know nothing about LaTex). More importantly you corrected my sloppy response regarding the covariance part. Thanks again, chl! $\endgroup$
    – bluepole
    Mar 20, 2012 at 21:26
  • $\begingroup$ Credits should go to @GGeco who provided details about the VC matrix; as I said, I only texified part of your reply (and +1). $\endgroup$
    – chl
    Mar 20, 2012 at 21:42
  • 5
    $\begingroup$ How would this work if you many random effects? $\endgroup$
    – user124123
    Jun 19, 2014 at 13:26

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.