I am having a statistical issue:
- subjects receive a test with machine A and machine B.
- 3 experts classify whether the results of machine A and machine B are acceptable (1) or not (0).
From my understanding, the data are repeated measurements (as each subject gets tested by both machine A and B), so I should use McNemar test. However, McNemar test only applies to 2x2 matrices as far as I know.
So how do I handle this:
- I cluster the opinions of all 3 experts and create a 2x2 table (ICC between their measurements is >0.80, so you could argue their agreement is strong enough to do that) (data_all below).
- I create 3 separate 2x2 McNemar tables (one for each expert) (data_1, data_2, data_3).
data_all <- matrix(c(100, 21, 100, 10), ncol=2, byrow=T) mcnemar.test(data_all) data_1 <- matrix(c(33, 7, 34, 3), ncol=2, byrow=T) mcnemar.test(data_1) data_2 <- matrix(c(33, 7, 33, 4), ncol=2, byrow=T) mcnemar.test(data_2) data_3 <- matrix(c(34, 7, 33, 3), ncol=2, byrow=T) mcnemar.test(data_3)
I am sorry if this question seems very basic.
Thank you very much!