Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

inference proportional change (dependent proportions) from before to after

I'm not sure whether the McNemar test is an appropriate choice in the situation below. I'd like to see whether an intervention had an effect on screening adherence, which can be done only once your ...
0 votes
0 answers
15 views

How to test whether the "prevalence ratio" of one marker is higher than that of another

Here is my setup. I have two sets of DNA sequences, one bound by a protein (transcription factor), another not bound by the protein. Let's say I have two candidate motifs, or DNA patterns the protein ...
1 vote
2 answers
464 views

test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
3 votes
1 answer
382 views

Which test to use? Repeated measures with binary outcomes

I would like your opinion about which analyses to use for the research question. I've got a repeated measures with binary data. N = 20 H0 = there is no difference between pre and post measurement ...
0 votes
0 answers
11 views

Enrichment of positive cases within paired data

I have analyzed 47 cancer samples from tissue and blood. In the tissue 40 are positive for a virus and in the blood 8 are positive for the virus Importantly, these 8 are the same patients that are ...
3 votes
1 answer
1k views

Comparing classifiers using McNemar Test

When comparing the performance of two binary classifiers using McNemar test, should the two confusion matrices of the models be based on the training set, the validation set, or even a second ...
1 vote
1 answer
437 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
1 vote
1 answer
292 views

Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?

Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
3 votes
1 answer
41 views

Comparing classifications based on different features with McNemar test

I have a classification task where I need to classify several land cover classes (such as forest, grass, water, etc.) based on two different sets of features (predictors). The first set of features ...
1 vote
1 answer
1k views

Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)

Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
1 vote
0 answers
26 views

What test for comparing results before and after an intervention?

I'm writing a paper in which we show a doctor some lab results for a group of patients and ask him to say yes or no to a diagnosis blindly. Then, I tell him the patient's history and other important ...
2 votes
1 answer
95 views

Chi square test (or alternative) for mixed design categorical data

I have the following question: I collected the number of different symptoms at two time points (Baseline BL, Follow-up FU) in two groups (Control Group CG, Intervention Group IG). So, there is a ...
0 votes
1 answer
414 views

What would be appropriate test to compare two lists of dichotomous variables?

Colleagues, can't wrap my mind on simple question, please help! I have two products and list of their attributes. My respondents make an answer which product on each attribute they prefer. Finally ...
0 votes
0 answers
20 views

Binding/ excluding groups for the McNemar Test

Our data is like this: Participants could choose one of four parties at baseline and at follow up (Germany has many political parties...). So the table for the raw data looks like this: For one ...
0 votes
0 answers
25 views

Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario

I am looking for the most suitable statistical test for the following situation: I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
0 votes
1 answer
72 views

Required sample size for exact McNemar test and for phi coefficient (power analysis)

I aim to establish the required sample size for my study. In the main analyses, which are conducted to test my hypotheses, I am investigating two 2x2 tables. Specifically, I plan to perform an exact ...
0 votes
0 answers
13 views

McNemar test or similar with multiple pairings?

Let's say I have test condition A and B, and a binary classification model. I have paired samples in conditions A and B, and I want to test if these conditions are different in classifier performance. ...
0 votes
0 answers
21 views

How can I apply McNemar’s test in matched case control study on SPSS?

When conducting a case-control study with 120 cases 1:1 to 120 controls and examining whether they had a binary exposure prior to developing the disease. I am using conditional logistic regression for ...
1 vote
0 answers
24 views

McNemar variant with multiple measurements per subject

I have a scenario where 3 subjects evaluate 12 cases of a problem with two pieces of equipment. Each subject evaluates each case with equipment A, then equipment B. The outcome variable is binary, 0 (...
1 vote
1 answer
51 views

How to derive sampling variance of paired differences?

I'm reading the paper (Mcnemar 1947), which introduces the origin of Mcnemar's test. And it gets me confused by understanding the equation of sampling variance of difference between proportional ...
0 votes
0 answers
9 views

Validating a new definition for detection

I am having some trouble understanding what approach I would use to validate a new set of definitions versus the "gold standard" to detect disease positivity. For example, if I wanted to say ...
1 vote
2 answers
99 views

Looking for an interaction between dichotomous variables with paired data using glmer in R

Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
1 vote
1 answer
96 views

How do I do McNemar test for propensity matched data in R?

I did propensity score matching for retrospective data, and now I want to run outcome analysis. For dichotomous variables, I heard that I need to do McNemar test since I should treat propensity score ...
1 vote
0 answers
88 views

Using McNemar-Bowker test to see if two metrics are measuring the same characteristic

I have a dataset of photos of dogs with both black and white fur. One person assessed the images by two criteria: Criteria 1: how much white fur does the dog have: More than 0% and less than 25% More ...
0 votes
0 answers
23 views

Relationship odds for conditional data and odds ratio for unconditional data

I have matched paired nominal data, transmissions and non-transmissions of a risk allele M1 from parents with genotypes M1M2, M1M1, M2M2 to affected children. We can build a 2x2 contingency table and ...
1 vote
0 answers
140 views

McNemar's test with multiple comparisons

I would like to test the difference between two classification outcomes for statistical significance using McNemar's test, but I am unsure how to best account for multiple comparisons. The setting is ...
2 votes
0 answers
613 views

Is Wilcoxon Test appropriate for paired categorical data?

There is currently a story in the news in the UK about negative effects of puberty blockers in children: 'It showed that after a year on puberty blockers, there was a significant increase found in ...
6 votes
1 answer
3k views

McNemar test with multiple scores for the same subject

I am having a statistical issue: subjects receive a test with machine A and machine B. 3 experts classify whether the results of machine A and machine B are acceptable (1) or not (0). From my ...
0 votes
0 answers
82 views

Chi-square test, McNemar test, or something else for comparing proportions of overlapping groups

Goal: I am trying to compare the proportion of participants who choose one of the combined options (A-B and B-A) in questions where they see A-First vs questions where they see B-First. Data: I have ...
1 vote
0 answers
59 views

I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set

I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
1 vote
0 answers
40 views

What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?

I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
3 votes
0 answers
319 views

Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
1 vote
0 answers
25 views

Self-perceived competence vs objectively measured competence: $\chi^2$ test of independence or McNemar's test?

My research question is to determine whether self-perceived competence is an indicator of objectively measured competence in a group of physiotherapy students? I have measured self-perceived ...
2 votes
1 answer
2k views

Repeated-measure contingency table with two variables with many levels?

I am trying to analyze the results of a survey on what would make people of different ages visit certain tourist places. However, age was collected as age-group (not my fault). Hence, it is a ...
1 vote
1 answer
283 views

Comparing diagnostic test in different populations

I have 5 diagnostic tests (test A, B, C and D) for a certain disease, tested in 2 different populations. For comparing test parameters (sensitivity, specificity) of test A and B in the same population ...
1 vote
0 answers
113 views

How to implement a Two-Sample McNemar Test in R

I'm trying to perform a Two-sample McNemar's test on my data, but I was not able two find any R package implementing the method. I'm familiar with the simple McNemar's test function mcnemar.test(), ...
0 votes
1 answer
71 views

All participants performed 12 binomial trials for the manipulation and control conditions. What is the best statistical test to compare conditions?

All 80 participants performed 12 binomial trials (0-failed, 1-success) for the manipulation condition and 12 binomial trials for the control condition. My database is something like this, but with ...
0 votes
0 answers
129 views

test for difference between matched pairs in 1:1 matched study

Background: I have a retrospective study (registry) that contains data on people with kidney transplant. Among these patients, we have a very small number of people with a specific genetic disease (n=...
1 vote
0 answers
378 views

How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test

I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
3 votes
0 answers
2k views

Chi-square test vs. McNemar's test - which test is right for this highly usual situation?

Here is, I would assume, a fairly common situation: I would like to know which test to use to assess whether the tendency to answer "Yes" on question 1 of a questionnaire is associated with ...
1 vote
1 answer
291 views

Chi-squared for repeated measures for 2 by n

I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
2 votes
1 answer
459 views

McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
0 votes
0 answers
389 views

Two tails or one tail McNemar's test in a binary classification problem. Which one should i choose?

I'm using McNemar's test for compare two designed models in a binary classification problem. As you know we have two kinds of this test. ...
1 vote
1 answer
434 views

McNemar test or Two proportion z-test?

Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is: Is there a difference between ...
3 votes
2 answers
351 views

Is McNemar's Test Appropriate Here?

I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
1 vote
0 answers
224 views

How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
2 votes
1 answer
34 views

Statistical test for PCR and bacterial culture with two different testing methods

I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
2 votes
0 answers
43 views

Confused about interpretation and intuition behind Mcnemar's Test [duplicate]

I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
2 votes
0 answers
104 views

How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
2 votes
1 answer
121 views

Another solution than McNemar test for bilateral asymmetry on binary data?

Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side. I need to test the ...