I have the following result from carrying out Cohen's kappa in R
library(irr) n = 100 o = c(rep(0,n), rep(1,n)) p = c(rbinom(n,1,0.5), rbinom(n,1,0.51)) k = kappa2( data.frame(p,o), "unweighted" ) k
Cohen's Kappa for 2 Raters (Weights: unweighted) Subjects = 200 Raters = 2 Kappa = -0.08 z = -1.13 p-value = 0.258
My interpretation of this
the test is displaying that there seems to be disagreement between the two vectors as kappa is negative. However, given the p value of 0.258 we can't say that this disagreement is significant, and may just be down to chance.
If someone could highlight if there is anything I'm missing from this interpretation that would be appreciated.