I have the following dataset, link here.
I have three variables:
- Dependent Variable 1: Grammatical Category
this is a nominal variable, and it has four categories: "verb", "adjective", "noun", "adverb".
- Dependent variable 2: Sentence Type
This is a nominal variable and it has three categories: "short", "medium", "long".
- Third variable : Language
This is independent variable and is nominal: "English", "Spanish".
The first column in the data sheet is the participant ID. The data is collected during individual interviews and the number of entries (observations) per participant is not the same, because each participant could have produced a different number of sentences during the interview.
My goal is to compare the combinations of the dependent variables in two languages. For example:
Is "verb-short" frequency significantly higher in English than in Spanish? and the same for other combinations: verb-medium, verb-long, adjective-short, adjective-long...
I did a general loglinear analysis, but there are a handful of expected counts which are below 5, therefore violating the test assumptions, and couple of adjusted residuals which are higher than +/-1.96.
I created a table in which I summarized the counts of the combinations per participant (111 participants in total, so 111 rows in my table) and 12 columns which corresponds to the 12 combinations of the two nominal variables. I tried a one-way anova and the assumptions of normal distribution is not met, there are a lot of zeros.
what is the best approach to analyse this data and what test should I use to compare the combinations between the two languages?
or alternatively question 2:
how can I compare only one category from variable 1 against other three categories in variable 2 within one language only? for example, in English verbs (one category from variable 1), compare "short" and "medium" and "long" with each other.