Lets say I have 2 factors and fully balanced groups:
condition (0, 1)
time (time1, time2)
I run a 2x2 between-within ANOVA and find a significant interaction. I proceed to test the simple main effects. I'm primarily interested in whether
condition1 are different from each other at
Is that simple main effect test the same as if I just used the
time2 data and ran an independent samples t-test between the two conditions?
For reference, these are the two tests I'm referring to in SPSS syntax:
GLM time1 time2 BY condition /WSFACTOR=time 2 Polynomial /METHOD=SSTYPE(3) /EMMEANS=TABLES(time*condition) compare(condition) /CRITERIA=ALPHA(.05) /WSDESIGN=time /DESIGN=condition. T-TEST GROUPS=condition(0 1) /MISSING=ANALYSIS /VARIABLES=time2 /CRITERIA=CI(.95).
I was always of the understanding that the tests are different and should give different results, and the answer here implies that simple main effect tests are not the same as separate t-tests. However, I created some normally distributed test data, ran the code above, and all of my results are identical
Should I expect to always see the same results (p value, degrees of freedom, standard error, CI values etc)? More importantly, under what conditions would you expect the two sets of results to differ?
If they are always expected to be the same, why would you ever run the (arguably) more complicated simple main effects test and not just use t-tests every time (assuming an interaction has been found)?