# Tag Info

Accepted

### McNemar or Fisher exact test for propensity score matched data?

This is definitely an ongoing debate in the literature, but at this point the evidence points to using paired analysis to compute standard errors and p-values. Although the goal of matching is to ...
• 33.4k
Accepted

...

### Can Cramér's V be used an effect size measure for McNemar's test?

Cramér's $V$ doesn't correspond well to what is tested by McNemar's test. Edit: Disclosure: the webpage and R package cited below are mine. Probably the most common effect size statistic for McNemar'...
• 11.4k
Accepted

### One-sided McNemar's test

I have described the gist of McNemar's test rather extensively here and here, it may help you to read those. Briefly, McNemar's test assesses the balance of the off-diagonal counts. If people were ...
Accepted

### Why aren't the diagonal counts used in McNemar's test?

The tag info for McNemar's test (once supplied by me, and later possibly modified): A repeated-measures test for categorical data. Given that two variables with the same 2 categories (McNemar ...
• 57.6k
Accepted

### Replacing McNemar test with regression?

The following example will work to model with logistic regression a test similar to McNemar's test on a 2 x 2 table. Essentially the dependent variable for a binomial logistic model takes on one value ...
• 11.4k

### Importance of McNemar test in caret::confusionMatrix

Interpret the McNemar’s Test for Classifiers McNemar’s Test captures the errors made by both models. Specifically, the No/Yes and Yes/No (A/B and B/A in your case) cells in the confusion matrix. The ...
• 225

• 283k

### Importance of McNemar test in caret::confusionMatrix

This is an interesting question that has different answers according to the context. I agree with what have answered you before, so here I will focus more on the context. It is normal that you have ...
• 171
Accepted

### Mcnemar's test p-value output in R confusion matrix

First, a p-value of 0.83 means you do not reject the null. Second, McNemar's test is about whether the row and column marginals are equal, or, equivalently, whether the "off-diagonal" elements are ...
• 120k
Accepted

### Compare a diagnostic test to gold standard

If you use McNemar's test you are testing whether the table is symmetric: whether more people are diagnosed sick by the new method and well by the old versus well by the new and sick by the old. This ...
• 17.8k

### Compare a diagnostic test to gold standard

You are asking about agreement, so you should use a test for agreement. With just two diagnostic measures ('raters') that are categorical in nature, the standard test is Cohen's kappa. Here's a ...
Accepted

### Can Cramér's V be used an effect size measure for McNemar's test?

In the context of a 2x2 table, Cramer's $V$ is equivalent to the phi coefficient. Moreover, phi is equivalent to Pearson's product moment correlation of the two columns of $1$'s and $0$'s when the ...
Accepted

### Is McNemar's Test Appropriate Here?

You could use McNemar's test. You do (potentially) have a 2x2 table. For each patient, you have the output from the two diagnostic tests, and the knowledge of the 'correct answer' from the gold ...
Accepted

### Interpretation of McNemar test example

Your data should be something like this: ...
• 5,107
Accepted

### How to derive sampling variance of paired differences？

To derive the sampling distribution of any statistics, you need to specify the underlying distribution first. For the paired data, although the paper you linked didn't make this clear, the joint ...
• 18.9k
Accepted

### Test for pairs of small integers

This problem calls for using a permutation test, a pure non-parametric test that does not have any normality assumptions. Check the "Hot Wings" example in Section 16 of these notes: http://arxiv.org/...
• 1,607

### Why aren't the diagonal counts used in McNemar's test?

Your intuition is reasonable, but incorrect. (As you note, that state of affairs is very common in probability and statistics.) Statistical significance vs. effect size / practical significance You ...