4
$\begingroup$

How do you interpret the standard deviation of the slope random effect in multilevel models?

Suppose I want to show how Urbanization percentage changed across time in Western and Eastern Europe, so it is a multilevel model with random slopes. Suppose the software shows that the mean of the standard deviation of the slope random effect is 0.05 (5%). How would the formal interpretation of it look like? I know that its interpretation is often not of a primary interest, but suppose that for some reasons I have to make it. How would it sound?

UPDATE:

Lachlan below has already provided an awesome answer to the main question asked. In this update I want to elaborate a bit on my model so as to further clarify my question.

I have fitted my model with INLA (Bayesian method), and it has only one fixed effect - fixed intercept, which is going to be the same for both regions (Western/Eastern Europe). So the question now is whether this fixed intercept plays a role of an overall average rate of change from which individual countries’ rates of changes deviate?

As a full example, we can consider a textbook model, at

https://becarioprecario.bitbucket.io/inla-gitbook/ch-multilevel.html#multilevel-models-for-longitudinal-data

The model here has the same specification as mine. IV here is also time (days of sleep deprivation) and DV is also a metric variable. There are 18 groups (subjects), so 18 random slopes, and only one fixed effect – intercept. Variability is presented as precision, but it can be converted to Standard deviation.

Below I have attached a picture from the book with my short notes.

enter image description here

Suppose, in this model we have converted "Precision for Subject" into Standard deviation. Does its mean show the amount of deviation of subjects’ individual rates of reaction times from the overall average rate of change, which in this model turns out to be a fixed intercept?

$\endgroup$

1 Answer 1

6
$\begingroup$

I am assuming you have fit a model in which you have estimated an overall average (fixed) effect of time and allowed the effect of time to vary by region (random slope). The model then estimates the overall average rate of urbanisation change (per unit of time) and the degree to which individual countries deviate from that overall average.

In short, the standard deviation of the random slope summarises how much countries tend to deviate from the overall average rate of urbanisation change. If the SD is small (contextually), the countries are similar in their urbanisation trajectories. If it's large, they tend to vary considerably.

More precisely, the standard deviation of the random slope estimates the standard deviation of the distribution of urbanisation rates within the population of interest (e.g., countries in Europe). So, your random slope having a standard deviation of 5% implies that 68% of countries within the population have rates of urbanisation change $\pm$ 5% from the overall average rate of change (given by the fixed effect). Similarly, you estimate that 95% of countries have a rate of urbanisation change within $\pm$ 10% of the overall average rate of urbanisation change.

UPDATE FOR ADDED DETAIL:

So the question now is whether this fixed intercept plays a role of an overall average rate of change from which individual countries’ rates of changes deviate?

No, not quite. In the sleep study example you've given, the fixed intercept represents the overall average Reaction time when Days = 0. Note that, because your model does not include a random intercept, your model constrains all subjects to have the same starting point. The interpretation of the intercept term is unrelated to the random slope.

Suppose, in this model we have converted "Precision for Subject" into Standard deviation. Does its mean show the amount of deviation of subjects’ individual rates of reaction times from the overall average rate of change, which in this model turns out to be a fixed intercept?

Not quite. In the (in my experience) more common formulation of the longitudinal model, a fixed effect for 'Days' is typically included. If this fixed effect term were included, your interpretation would be right. The coefficient for the fixed effect Days would represent the overall average slope and the standard deviation of the random slope term would summarise how much the Subject-specific slopes vary about that average.

In the model you've described, the standard deviation of the random slope instead summarises the deviation of subjects’ individual rates of reaction time change from zero. Including a random slope without a corresponding fixed effect is like including an interaction term without the corresponding main effect. The main effect is assumed to be exactly zero. When the overall average is non-zero, as in the sleep study example, this can produce quite poor model fit.

The model here has the same specification as mine.

Take this with a grain of salt as I'm not familiar with INLA or its syntax, but the model described seems a bit unusual for longitudinal data, especially for the kind you have described. Firstly, as mentioned, because a fixed effect for Days is not included, the overall average slope is forced to be zero. Secondly, the starting point (Days = 0) for each subject is constrained to be equal, as you have not allowed the intercept to vary by Subject. Additionally, when you include a random intercept and a random slope, this allows for estimating the correlation between that intercept and slope. This can help to answer questions such as: do people with better reaction time at baseline tend to deteriorate more rapidly?

This link details implementing the correlated random intercept and slope models in INLA if that's of interest.

$\endgroup$
7
  • $\begingroup$ Thanks, this is super helpful! I have fitted this model with INLA (Bayesian method). The only fixed effect in my model is a fixed intercept, which is going to be the same for both regions (Western/Eastern Europe). So does it mean that this fixed intercept is the overall average rate of change from which individual countries’ rates of changes deviate? $\endgroup$
    – Rustam
    Aug 1, 2022 at 14:04
  • 1
    $\begingroup$ I don't quite understand the model you've fitted. Could you elaborate a bit? Note that a random slope is an interaction. An interaction between the predictor of interest (e.g. time) and the grouping variable (country), thereby allowing the predictor to have a distinct effect in each country. Interactions usually only make sense when the main effects are also present. The same is true for random slopes. Most often if you have a random slope you also should have the fixed effect for that predictor. Otherwise you're assuming the overall average rate of urbanisation change is precisely zero. $\endgroup$
    – Lachlan
    Aug 2, 2022 at 0:00
  • $\begingroup$ I have updated my question so as to include a hyperlink and a picture. I have made a reference to a textbook example, which has the same model specification as mine $\endgroup$
    – Rustam
    Aug 2, 2022 at 8:57
  • 1
    $\begingroup$ Thanks for the extra info. I've added some detail to the response. $\endgroup$
    – Lachlan
    Aug 3, 2022 at 2:48
  • 1
    $\begingroup$ Yes! I know just the one. Singer and Willett Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence (2003). Does an amazing job of building intuition for these kinds of models. It has also been translated into R code with the Bayesian brms package: bookdown.org/content/ef0b28f7-8bdf-4ba7-ae2c-bc2b1f012283 $\endgroup$
    – Lachlan
    Aug 3, 2022 at 12:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.