Repeated measures but not longitudinal: A case of multivariate LMM or repeated measures LMM?

Question

I am trying to get my head around the question of what kind of model is most appropriate for the following data:

Every participant rated 14 written statements in terms of various aspects (e.g. credibility, writing style, and logic). All aspects were rated on a Likert scale from 1-7. The statements were presented randomly.

The dataset looks as follows in the long form (example with 4 statements instead of 14):

I would like to explore what predicts the perceived credibility.

Predictors: writing_style, logic

Outcome/y: credibility

I am thinking of my data as having the individual at L2 and the statements (repeated measures/observations) at L1.

First, I was thinking that this is an instance of an LMM with repeated measures (as I repeatedly measure the same thing but it is measured for different items, i.e. statements, rather than for different points in time). However, most examples I encountered in literature or found online are longitudinal studies which does not apply to my data.

Question: I began to wonder whether my data needs to be understood as multivariate or whether it can still be analysed as LMM with repeated measures but perhaps something needs to be analysed differently as the sequence is not of interest?

Answer 1

I am thinking of my data as having the individual at L2 and the statements (repeated measures/observations) at L1.

I don't see how statements are nested within individuals because each statement occurs within every individual.

Observations are repeated/nested/clustered within individuals, so observations on the same individual will be more alike one another than observations on another individual and hence not independent, and that's why we use a random intercept for ID. But observations are also nested within statements, that is, each observation "belongs" to a particular statement (as well as to an individual), and this creates further dependence among the observations for that statement, because observations on the same statement will be more similar to one another than those on another statement and hence the random intercept for statement. Statements are not nested within individuals because each statement does not "belong" to any one individual. So this is a 2-level model with crossed random effects (cross-classified)

To make this clearer, contrast your setup with a 3-level model, where repeated observations (L1) are made on pupils (L2) in schools (L3). Observations are nested within pupils and pupils are nested with schools. Each observation "belongs" to one pupil, and each pupil "belongs" to one school

You could model this as a (generalized) linear mixed model. Due to the nature of your outcome variable (7 point likert item) you should ideally fit a model that allows an ordinal outcome as well as crossed random effects, such as MCMCglmm or clmm in the ordinal package. With clmm this would look something like:

clmm(credibility ~ writing_style + logic + (1|ID) + (1|statement), data=mydata)