I have a 2(truthfulness) x 2 (immediate test) study where I am looking to compare 2 logistic regression models.
Both are classifying the same outcome variable: truthfulness (truthful versus deceptive -- an experimental manipulation where they were told to tell the truth or lie). The independent variable in both is a score on a delayed test.
The first model uses scores for people who did the immediate test, the other model uses scores for people who did not do the immediate test. I want to know whether truthfulness can be classified better using scores on the delayed test when people have previously done the immediate test.
However, I am confused as to how to compare logistic regression models. Is it possible to do that even though models are estimated from different samples? Is it possible to interpret differences between classification accuracy tables as meaningful? And is it possible to statistically test the differences between models?