Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

80 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4 votes
0 answers
288 views

Does conditional logistic regression effectively "throw away" concordant pairs like McNemar's test?

We are interested in analyzing pre-post data from a randomized control trial. The outcome is binary and I am trying to explain the heuristics of the model formulation for conditional logistic ...
AdamO's user avatar
  • 62.7k
3 votes
0 answers
319 views

Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
GaryStats's user avatar
3 votes
0 answers
48 views

Does sampling fraction matter for McNemar's Test?

For McNemar's Test, does the sample need to be less than 1/20 of the population if the sample is without replacement? If so, can I correct for a sample that is larger than 1/20 of the population by ...
John Doe's user avatar
3 votes
1 answer
1k views

Comparing classifiers using McNemar Test

When comparing the performance of two binary classifiers using McNemar test, should the two confusion matrices of the models be based on the training set, the validation set, or even a second ...
salvador's user avatar
  • 147
3 votes
0 answers
2k views

Chi-square test vs. McNemar's test - which test is right for this highly usual situation?

Here is, I would assume, a fairly common situation: I would like to know which test to use to assess whether the tendency to answer "Yes" on question 1 of a questionnaire is associated with ...
NamelessAmos's user avatar
3 votes
0 answers
565 views

Pearson's chi-squared test assumption: independence of observations

I am unsure of how to establish (or interpret) the independence condition of the chi-squared test in (for instance) the following situation. Consider this 2x2 contingency table representing the ...
BrechtDeMan's user avatar
3 votes
1 answer
382 views

Which test to use? Repeated measures with binary outcomes

I would like your opinion about which analyses to use for the research question. I've got a repeated measures with binary data. N = 20 H0 = there is no difference between pre and post measurement ...
user143223's user avatar
2 votes
0 answers
104 views

How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
Roas Clack's user avatar
2 votes
0 answers
85 views

Analyze Repeated Measures of a Frequency

I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
Brittany Carter's user avatar
2 votes
1 answer
121 views

Another solution than McNemar test for bilateral asymmetry on binary data?

Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side. I need to test the ...
wburton's user avatar
  • 21
2 votes
0 answers
614 views

Is Wilcoxon Test appropriate for paired categorical data?

There is currently a story in the news in the UK about negative effects of puberty blockers in children: 'It showed that after a year on puberty blockers, there was a significant increase found in ...
Dave's user avatar
  • 197
2 votes
0 answers
66 views

Comparing "paired" proportions with different totals

I have long-term survey data for trees infected with a virus. The data was measured in 2000 and again in 2010. I'd like to compare the number of uninfected vs. infected trees in 2000 and 2010. However,...
Ouwan12's user avatar
  • 21
2 votes
0 answers
739 views

Can Cochran's Q test take a 3 level nominal variable as the response (instead of 2)?

I conducted a study using within-subjects (repeated measure) design for collecting nominal data. I have been reading a lot closet I get for a suitable test is Cochran's Q test since I have repeated ...
Fatma S's user avatar
  • 23
2 votes
0 answers
248 views

Comparison of multiple diagnostic tests with paired data

Good Day All, I am attempting to compare three diagnostic tests against a gold-standard and for simplicity sake, let us have all the outcomes be binary (disease/no disease). In this study study, all ...
user918967's user avatar
2 votes
0 answers
272 views

Comparing proportions from the (somewhat) same sample

I’m looking for some help on testing whether there are statistical differences between proportions when the data is dependent. By dependent, I mean that all the data is from the same participants ...
SimonsSchus's user avatar
1 vote
0 answers
26 views

What test for comparing results before and after an intervention?

I'm writing a paper in which we show a doctor some lab results for a group of patients and ask him to say yes or no to a diagnosis blindly. Then, I tell him the patient's history and other important ...
Alex Horrillo's user avatar
1 vote
0 answers
24 views

McNemar variant with multiple measurements per subject

I have a scenario where 3 subjects evaluate 12 cases of a problem with two pieces of equipment. Each subject evaluates each case with equipment A, then equipment B. The outcome variable is binary, 0 (...
Abrams's user avatar
  • 11
1 vote
1 answer
99 views

How do I do McNemar test for propensity matched data in R?

I did propensity score matching for retrospective data, and now I want to run outcome analysis. For dichotomous variables, I heard that I need to do McNemar test since I should treat propensity score ...
suyeon kim's user avatar
1 vote
0 answers
89 views

Using McNemar-Bowker test to see if two metrics are measuring the same characteristic

I have a dataset of photos of dogs with both black and white fur. One person assessed the images by two criteria: Criteria 1: how much white fur does the dog have: More than 0% and less than 25% More ...
An Hernández's user avatar
1 vote
0 answers
142 views

McNemar's test with multiple comparisons

I would like to test the difference between two classification outcomes for statistical significance using McNemar's test, but I am unsure how to best account for multiple comparisons. The setting is ...
fourleafclover's user avatar
1 vote
0 answers
59 views

I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set

I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
Harry_Fallows's user avatar
1 vote
0 answers
25 views

Self-perceived competence vs objectively measured competence: $\chi^2$ test of independence or McNemar's test?

My research question is to determine whether self-perceived competence is an indicator of objectively measured competence in a group of physiotherapy students? I have measured self-perceived ...
George Deacon's user avatar
1 vote
0 answers
113 views

How to implement a Two-Sample McNemar Test in R

I'm trying to perform a Two-sample McNemar's test on my data, but I was not able two find any R package implementing the method. I'm familiar with the simple McNemar's test function mcnemar.test(), ...
Abel Aussant's user avatar
1 vote
0 answers
40 views

What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?

I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
Amy's user avatar
  • 21
1 vote
0 answers
224 views

How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
Quinten's user avatar
  • 389
1 vote
2 answers
465 views

test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
Frank Gallagher's user avatar
1 vote
1 answer
440 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
tcvdb1992's user avatar
  • 139
1 vote
0 answers
39 views

Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
Alex Pl's user avatar
  • 11
1 vote
0 answers
369 views

Comparing two multi-class machine learning classifiers using Stuart Maxwell Test

I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps: obtain prediction on test data using ...
ILR's user avatar
  • 23
1 vote
0 answers
568 views

When is "Cochran–Mantel–Haenszel" like "McNemar's test"?

In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
Tal Galili's user avatar
  • 21.6k
1 vote
1 answer
1k views

Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)

Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
Tal Galili's user avatar
  • 21.6k
1 vote
0 answers
33 views

is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?

the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
macstatistics's user avatar
1 vote
0 answers
378 views

How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test

I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
gaspar's user avatar
  • 234
1 vote
0 answers
17 views

Comparing responses between groups and conditions

I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
Dario's user avatar
  • 11
1 vote
1 answer
293 views

Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?

Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
mintypasta's user avatar
1 vote
0 answers
23 views

Chi2 versus other tests for dependent samples (same observer different time)

I have come across a problem at deciding which hypothesis test I should use. I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
Maximiliano Gabriel Castro's user avatar
1 vote
1 answer
32 views

How to Test Sampling Methods

Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
Brian's user avatar
  • 111
1 vote
1 answer
195 views

Conditional Exact Logistic Regression

I have paired data for two tests. I would like to say that Test A is more sensitive than Best B, but not sure if I'm using the correct methods or if my data support it. I know McNemar's Exact test can ...
James H.'s user avatar
1 vote
0 answers
1k views

How do I get an odds ratio with McNemar's test?

I have pre and post test data evaluating the effectiveness of a lesson about how to help friends who are being bullied. I am trying to see if more students know how to help a friend being bullied ...
Charlotte Lane's user avatar
1 vote
0 answers
34 views

Statistical test for testing different between groups in terms of efficiency in regression

During my thesis work I collected some measurements about chest compressions that reached a good depth (binomial data) during cardiopulmonary rescuscitaion (CPR), I have two groupes of volunteers and ...
houcine's user avatar
  • 11
1 vote
0 answers
1k views

Sample size determination for before/after study

I would like to estimate the required sample size for a study where I have subjects first undergo an observation (control) period of X months and then an intervention period of Y months. The outcome ...
user2557662's user avatar
1 vote
0 answers
163 views

Does this meet the assumptions for McNemar's Test?

On the NIST page about McNemar's Test, the third listed assumption is that "The difference P(Xi = 0, Yi = 1) - P(Xi = 1, Yi = 0) is negative for all i or zero for all i or positive for all i." Let's ...
John Doe's user avatar
1 vote
0 answers
2k views

McNemar test for three groups

I'm trying to examine the difference in proportions of outcomes from three different tests (positive, negative, unsure). I want to compare what proportions of outcomes is positive for each test. All ...
Zip's user avatar
  • 11
1 vote
0 answers
244 views

Comparing the performance of random and weighted-random classifiers

I have a set of 300 observations of known class and there are 20 classes in total. I want to compare the performance of a random classifier with a weighted-random classifier at classifying the ...
hendra's user avatar
  • 111
1 vote
1 answer
96 views

McNemar test for this application?

I'm doing a study on the compliance of schools with questions in a standard 12 question questionnaire at two points in time (2010 and 2015). Basically the American Heart Association puts out a ...
MG Funs's user avatar
  • 11
1 vote
0 answers
2k views

Alternatives to McNemar-Bowker test when symmetrical cells have zero count in contingency matrix

I need to test the difference between pre- and post- intervention over a 4-grades parameter computed on 57 samples. The contingency matrix on which I need to compute a McNemar test for paired data (...
Franz's user avatar
  • 95
1 vote
0 answers
366 views

Test for paired data on categorical variable with >2 levels

I am looking for the appropriate statistical test to compare frequencies over a categorical variable with >2 classes, for paired data (in practice, each individual has been labelled A, B, C or D ...
user avatar
1 vote
0 answers
57 views

Can I sum up my count data instead of performing some repeated measures analysis?

I want to analyze establishment of plants in created gaps (plots): I have 10 treated plots, which are divided into an outer section and an inner one and I have been looking at these plots over a ...
avaria's user avatar
  • 11
1 vote
0 answers
2k views

Statistical test for paired data in an r x c contingency table

To perform statistical test on paired data when we have two dichotomous nominal variables (i.e., in a 2 x 2 contingency table) we can use the McNemar's test. When ...
Ayalew A.'s user avatar
  • 635
1 vote
0 answers
32 views

Self-selected groups categorical breakdown test

I have a population of people, and one group who was self-selected (group A), and the remainder of the population (group B), and each group is broken into a group of n nominal categories (categories ...
Nathan B.'s user avatar