Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
0 votes
0 answers
20 views

Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario

I am looking for the most suitable statistical test for the following situation: I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
Tom 's user avatar
  • 1
0 votes
1 answer
43 views

Required sample size for exact McNemar test and for phi coefficient (power analysis)

I aim to establish the required sample size for my study. In the main analyses, which are conducted to test my hypotheses, I am investigating two 2x2 tables. Specifically, I plan to perform an exact ...
Louis's user avatar
  • 1
0 votes
0 answers
10 views

McNemar test or similar with multiple pairings?

Let's say I have test condition A and B, and a binary classification model. I have paired samples in conditions A and B, and I want to test if these conditions are different in classifier performance. ...
James's user avatar
  • 1
0 votes
0 answers
20 views

How can I apply McNemar’s test in matched case control study on SPSS?

When conducting a case-control study with 120 cases 1:1 to 120 controls and examining whether they had a binary exposure prior to developing the disease. I am using conditional logistic regression for ...
Sari Taha's user avatar
0 votes
0 answers
14 views

Would the McNemar test be appropriate for my data?

I have raw mass spec data collected from 300 subjects. I have processed this data to extract out the number of features. I have run this with settings A and then run this again with different settings ...
aim6789's user avatar
  • 53
1 vote
0 answers
16 views

McNemar variant with multiple measurements per subject

I have a scenario where 3 subjects evaluate 12 cases of a problem with two pieces of equipment. Each subject evaluates each case with equipment A, then equipment B. The outcome variable is binary, 0 (...
Abrams's user avatar
  • 11
0 votes
0 answers
8 views

Enrichment of positive cases within paired data

I have analyzed 47 cancer samples from tissue and blood. in the tissue 40 are positive for a virus and in the blood 8 are positive for the virus Importantly, these 8 are the same patients that are ...
user2300940's user avatar
0 votes
0 answers
8 views

Validating a new definition for detection

I am having some trouble understanding what approach I would use to validate a new set of definitions versus the "gold standard" to detect disease positivity. For example, if I wanted to say ...
Levi M's user avatar
  • 75
1 vote
1 answer
71 views

How do I do McNemar test for propensity matched data in R?

I did propensity score matching for retrospective data, and now I want to run outcome analysis. For dichotomous variables, I heard that I need to do McNemar test since I should treat propensity score ...
suyeon kim's user avatar
1 vote
0 answers
70 views

Using McNemar-Bowker test to see if two metrics are measuring the same characteristic

I have a dataset of photos of dogs with both black and white fur. One person assessed the images by two criteria: Criteria 1: how much white fur does the dog have: More than 0% and less than 25% More ...
An Hernández's user avatar
0 votes
0 answers
23 views

Relationship odds for conditional data and odds ratio for unconditional data

I have matched paired nominal data, transmissions and non-transmissions of a risk allele M1 from parents with genotypes M1M2, M1M1, M2M2 to affected children. We can build a 2x2 contingency table and ...
lmb8's user avatar
  • 43
1 vote
0 answers
81 views

McNemar's test with multiple comparisons

I would like to test the difference between two classification outcomes for statistical significance using McNemar's test, but I am unsure how to best account for multiple comparisons. The setting is ...
fourleafclover's user avatar
0 votes
0 answers
67 views

Chi-square test, McNemar test, or something else for comparing proportions of overlapping groups

Goal: I am trying to compare the proportion of participants who choose one of the combined options (A-B and B-A) in questions where they see A-First vs questions where they see B-First. Data: I have ...
melbez's user avatar
  • 165
1 vote
0 answers
50 views

I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set

I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
Harry_Fallows's user avatar
1 vote
1 answer
49 views

How to derive sampling variance of paired differences?

I'm reading the paper (Mcnemar 1947), which introduces the origin of Mcnemar's test. And it gets me confused by understanding the equation of sampling variance of difference between proportional ...
Palantir's user avatar
1 vote
0 answers
24 views

Self-perceived competence vs objectively measured competence: $\chi^2$ test of independence or McNemar's test?

My research question is to determine whether self-perceived competence is an indicator of objectively measured competence in a group of physiotherapy students? I have measured self-perceived ...
George Deacon's user avatar
1 vote
1 answer
228 views

Comparing diagnostic test in different populations

I have 5 diagnostic tests (test A, B, C and D) for a certain disease, tested in 2 different populations. For comparing test parameters (sensitivity, specificity) of test A and B in the same population ...
Adrián Valls Carbó's user avatar
1 vote
0 answers
97 views

How to implement a Two-Sample McNemar Test in R

I'm trying to perform a Two-sample McNemar's test on my data, but I was not able two find any R package implementing the method. I'm familiar with the simple McNemar's test function mcnemar.test(), ...
Abel Aussant's user avatar
0 votes
1 answer
71 views

All participants performed 12 binomial trials for the manipulation and control conditions. What is the best statistical test to compare conditions?

All 80 participants performed 12 binomial trials (0-failed, 1-success) for the manipulation condition and 12 binomial trials for the control condition. My database is something like this, but with ...
Olivia's user avatar
  • 101
0 votes
0 answers
115 views

test for difference between matched pairs in 1:1 matched study

Background: I have a retrospective study (registry) that contains data on people with kidney transplant. Among these patients, we have a very small number of people with a specific genetic disease (n=...
R. Simian's user avatar
1 vote
1 answer
244 views

Chi-squared for repeated measures for 2 by n

I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
jpsmith's user avatar
  • 307
1 vote
1 answer
340 views

McNemar test or Two proportion z-test?

Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is: Is there a difference between ...
jrf's user avatar
  • 13
1 vote
0 answers
40 views

What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?

I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
Amy's user avatar
  • 21
1 vote
0 answers
199 views

How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
Quinten's user avatar
  • 359
2 votes
1 answer
34 views

Statistical test for PCR and bacterial culture with two different testing methods

I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
user357727's user avatar
2 votes
0 answers
42 views

Confused about interpretation and intuition behind Mcnemar's Test [duplicate]

I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
Jax's user avatar
  • 21
2 votes
0 answers
104 views

How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
Roas Clack's user avatar
0 votes
0 answers
17 views

deciphering between statistical tests

I want would like to test if the mean iron concentrations were higher at delivery time in the vaxx group compared to the placebo ,what hypothesis test would i use
user avatar
0 votes
0 answers
68 views

What kind of significance tests can I apply on before/after data that involves proportions?

I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages. There are two columns which show the ...
Ze0ruso's user avatar
  • 111
1 vote
2 answers
428 views

test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
Frank Gallagher's user avatar
0 votes
1 answer
142 views

Test for pre-post test binary data for 3 groups

I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
jfish's user avatar
  • 1
3 votes
2 answers
440 views

Replacing McNemar test with regression?

Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)? Let's have a made-up example ...
ethan282712's user avatar
3 votes
0 answers
285 views

Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
GaryStats's user avatar
1 vote
1 answer
364 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
tcvdb1992's user avatar
  • 139
0 votes
1 answer
262 views

McNemar exact DP test not running in R [closed]

I am unable to run the provided example (copy/pasted from here): ...
StatsSorceress's user avatar
1 vote
1 answer
374 views

In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?

In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results: ...
StatsSorceress's user avatar
0 votes
0 answers
107 views

Two categorical variables with many levels, dependent samples

I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
Vasco Brazao's user avatar
0 votes
0 answers
96 views

Confusion matrix test-retest reliability (McNemar or paired t-test)

I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
Kayla0x41's user avatar
1 vote
0 answers
38 views

Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
Alex Pl's user avatar
  • 11
1 vote
2 answers
2k views

McNemar-Bowker exact test in R: difficulty interpreting the results

I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
ILR's user avatar
  • 23
1 vote
0 answers
332 views

Comparing two multi-class machine learning classifiers using Stuart Maxwell Test

I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps: obtain prediction on test data using ...
ILR's user avatar
  • 23
2 votes
1 answer
404 views

McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
thanksForTheHelp12's user avatar
0 votes
1 answer
496 views

Stratification McNemar Test in R

I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc). What I need to know if ...
Sara's user avatar
  • 41
0 votes
0 answers
29 views

How to select dichotomous variables?

I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
JonB's user avatar
  • 2,850
1 vote
0 answers
511 views

When is "Cochran–Mantel–Haenszel" like "McNemar's test"?

In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
Tal Galili's user avatar
  • 21.1k
1 vote
1 answer
1k views

Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)

Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
Tal Galili's user avatar
  • 21.1k
1 vote
2 answers
97 views

Looking for an interaction between dichotomous variables with paired data using glmer in R

Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
Graeme Ruxton's user avatar
1 vote
0 answers
32 views

is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?

the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
macstatistics's user avatar
1 vote
1 answer
363 views

Interpretation of McNemar test example

In this tutorial https://learningstatisticswithr.com/book/chisquare.html in Example 12.8.1 I understand the result of the test ...
Ana's user avatar
  • 71
2 votes
0 answers
81 views

Analyze Repeated Measures of a Frequency

I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
Brittany Carter's user avatar