# Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

179 questions
Filter by
Sorted by
Tagged with
20 views

### Comparison Sensitivity and Specificity - hold one stable for comparison of the other?

Given two binary diagnostic tests, T1 and T2, I want to compare the Sensitivity and Specificity of the two tests when given to a sample of subjects. Each subject will receive both tests, and there is ...
• 1,160
1 vote
50 views

### Comparing outcomes from 2 diagnostic criteria (McNemar Exact Test?)

First time poster here. I am stuck trying to figure out the correct statistical test for my research question. I am comparing two possible outcomes using the results from the same dataset. These ...
• 11
1 vote
26 views

### What type of test should I use for paired categorical data?

Somewhat similar questions have been asked here and here, but none of the other answers are really applicable in my case. I have a group of people, where in Year 1 everybody is sick. Here I have only ...
• 11
27 views

### Is there an way to model random effects in a design that is typically analyzed by the McNemar test?

My question is: if in a study with paired binary response data (where McNemar test is often used) we can use the exact binomial test to test the odds ratio, is it possible to model the same odds ratio ...
18 views

### How to test whether the "prevalence ratio" of one marker is higher than that of another

Here is my setup. I have two sets of DNA sequences, one bound by a protein (transcription factor), another not bound by the protein. Let's say I have two candidate motifs, or DNA patterns the protein ...
9 views

### inference proportional change (dependent proportions) from before to after

I'm not sure whether the McNemar test is an appropriate choice in the situation below. I'd like to see whether an intervention had an effect on screening adherence, which can be done only once your ...
51 views

### Comparing classifications based on different features with McNemar test

I have a classification task where I need to classify several land cover classes (such as forest, grass, water, etc.) based on two different sets of features (predictors). The first set of features ...
• 183
1 vote
32 views

### What test for comparing results before and after an intervention?

I'm writing a paper in which we show a doctor some lab results for a group of patients and ask him to say yes or no to a diagnosis blindly. Then, I tell him the patient's history and other important ...
106 views

### Chi square test (or alternative) for mixed design categorical data

I have the following question: I collected the number of different symptoms at two time points (Baseline BL, Follow-up FU) in two groups (Control Group CG, Intervention Group IG). So, there is a ...
30 views

### Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario

I am looking for the most suitable statistical test for the following situation: I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
• 1
126 views

### Required sample size for exact McNemar test and for phi coefficient (power analysis)

I aim to establish the required sample size for my study. In the main analyses, which are conducted to test my hypotheses, I am investigating two 2x2 tables. Specifically, I plan to perform an exact ...
33 views

### McNemar test or similar with multiple pairings?

Let's say I have test condition A and B, and a binary classification model. I have paired samples in conditions A and B, and I want to test if these conditions are different in classifier performance. ...
27 views

### How can I apply McNemar’s test in matched case control study on SPSS?

When conducting a case-control study with 120 cases 1:1 to 120 controls and examining whether they had a binary exposure prior to developing the disease. I am using conditional logistic regression for ...
1 vote
31 views

### McNemar variant with multiple measurements per subject

I have a scenario where 3 subjects evaluate 12 cases of a problem with two pieces of equipment. Each subject evaluates each case with equipment A, then equipment B. The outcome variable is binary, 0 (...
• 11
10 views

### Validating a new definition for detection

I am having some trouble understanding what approach I would use to validate a new set of definitions versus the "gold standard" to detect disease positivity. For example, if I wanted to say ...
• 75
1 vote
135 views

### How do I do McNemar test for propensity matched data in R?

I did propensity score matching for retrospective data, and now I want to run outcome analysis. For dichotomous variables, I heard that I need to do McNemar test since I should treat propensity score ...
1 vote
117 views

### Using McNemar-Bowker test to see if two metrics are measuring the same characteristic

I have a dataset of photos of dogs with both black and white fur. One person assessed the images by two criteria: Criteria 1: how much white fur does the dog have: More than 0% and less than 25% More ...
1 vote
191 views

### McNemar's test with multiple comparisons

I would like to test the difference between two classification outcomes for statistical significance using McNemar's test, but I am unsure how to best account for multiple comparisons. The setting is ...
92 views

### Chi-square test, McNemar test, or something else for comparing proportions of overlapping groups

Goal: I am trying to compare the proportion of participants who choose one of the combined options (A-B and B-A) in questions where they see A-First vs questions where they see B-First. Data: I have ...
• 165
1 vote
68 views

### I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set

I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
1 vote
57 views

### How to derive sampling variance of paired differences？

I'm reading the paper (Mcnemar 1947), which introduces the origin of Mcnemar's test. And it gets me confused by understanding the equation of sampling variance of difference between proportional ...
• 27
1 vote
26 views

### Self-perceived competence vs objectively measured competence: $\chi^2$ test of independence or McNemar's test?

My research question is to determine whether self-perceived competence is an indicator of objectively measured competence in a group of physiotherapy students? I have measured self-perceived ...
1 vote
359 views

### Comparing diagnostic test in different populations

I have 5 diagnostic tests (test A, B, C and D) for a certain disease, tested in 2 different populations. For comparing test parameters (sensitivity, specificity) of test A and B in the same population ...
1 vote
118 views

### How to implement a Two-Sample McNemar Test in R [closed]

I'm trying to perform a Two-sample McNemar's test on my data, but I was not able two find any R package implementing the method. I'm familiar with the simple McNemar's test function mcnemar.test(), ...
1 vote
76 views

### All participants performed 12 binomial trials for the manipulation and control conditions. What is the best statistical test to compare conditions?

All 80 participants performed 12 binomial trials (0-failed, 1-success) for the manipulation condition and 12 binomial trials for the control condition. My database is something like this, but with ...
• 365
147 views

### test for difference between matched pairs in 1:1 matched study

Background: I have a retrospective study (registry) that contains data on people with kidney transplant. Among these patients, we have a very small number of people with a specific genetic disease (n=...
• 173
1 vote
330 views

### Chi-squared for repeated measures for 2 by n

I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
• 329
1 vote
519 views

### McNemar test or Two proportion z-test?

Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is: Is there a difference between ...
• 13
1 vote
42 views

### What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?

I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
• 21
1 vote
238 views

### How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
• 389
40 views

### Statistical test for PCR and bacterial culture with two different testing methods

I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
43 views

### Confused about interpretation and intuition behind Mcnemar's Test [duplicate]

I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
• 21
104 views

### How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
17 views

### deciphering between statistical tests

I want would like to test if the mean iron concentrations were higher at delivery time in the vaxx group compared to the placebo ,what hypothesis test would i use
69 views

### What kind of significance tests can I apply on before/after data that involves proportions?

I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages. There are two columns which show the ...
• 121
495 views

### test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
166 views

### Test for pre-post test binary data for 3 groups

I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
579 views

### Replacing McNemar test with regression?

Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)? Let's have a made-up example ...
349 views

### Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
1 vote
500 views

### Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
• 139
299 views

### McNemar exact DP test not running in R [closed]

I am unable to run the provided example (copy/pasted from here): ...
1 vote
427 views

### In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?

In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results: ...
112 views

### Two categorical variables with many levels, dependent samples

I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
107 views

### Confusion matrix test-retest reliability (McNemar or paired t-test)

I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1 vote
39 views

### Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
• 11
1 vote
2k views

### McNemar-Bowker exact test in R: difficulty interpreting the results

I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
• 23
1 vote
384 views

### Comparing two multi-class machine learning classifiers using Stuart Maxwell Test

I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps: obtain prediction on test data using ...
• 23
502 views

### McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
599 views

### Stratification McNemar Test in R

I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc). What I need to know if ...
• 41