I have more of a brainstorming type of question for statisticians and I would like to know what your thoughts are. I'll describe my data sets, so you can judge what type of statistical problem they involve.
I have two different language experiments: one was done with Spanish speakers and one was done with English speakers. Both experiments have exactly the same design: a 2 by 2 within subjects design, crossing two factors, "grammaticality" (grammatical/ungrammatical word) and "number" (singular/plural word). I am interested in the interaction between these two factors. When I run a my statistical model (a factorial anova using lmer in R) I get a significant interaction in both cases: beta / the interaction coefficient is significantly different from 0, with p <0.05
My goal is to compare the value of beta between the two data sets (since I have two experiments, I have one beta value for the Spanish experiment and one beta value for the English experiment). In order to do that, I was thinking of providing the beta value for each experiment and getting a confidence interval for each beta, with the goal of showing that the two values (and their CIs) are not that different.
I am trying to figure out which is the most appropriate way of calculating the 95% CIs. I thought of doing bootstrapping as a way of getting them. So I guess my questions are:
Is this way (providing the betas for English and Spanish and the 95% bootstrapped CIs?) a clear way of comparing across experiments? (that is, are there other more appropriate statistical ways of making the comparison across languages?)
Is bootstrapping an adequate way of getting the CIs? And if not, how would you get them?
Let me know if this was unclear or if you need me to expand and thanks!