I am new to this website, and I hope to find help. I am writing my MSc thesis on phishing education.
I have three groups and use pretest-posttest experimental design
- Training 1
- Training 2
It aims to test whether anti-phishing training is effective in educating users to recognise phishing emails. I also use few control variables such as demographics ones, IT self-efficacy, etc.
The dependent measure is the final score.
These are the tests that I used:
- One-way Anova followed by Post hoc Tukey and paired t-test to compare the scores between pre and post-test. However, it turned out that my post-test is more difficult than my pre-test; this is a big limitation (I don't know how to address this issue)
- Signal detection theory: One-way Anova followed by Post hoc Tukey and paired t-test was used to examine: False negatives and false positives rates/Sensitivity and criterion.
I would like to know whether my tests are sufficient or I need additional analysis?