Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
0 votes
0 answers
28 views

How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
user avatar
  • 101
2 votes
1 answer
21 views

Statistical test for PCR and bacterial culture with two different testing methods

I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
user avatar
2 votes
0 answers
40 views

Confused about interpretation and intuition behind Mcnemar's Test [duplicate]

I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
user avatar
  • 21
0 votes
0 answers
58 views

Choosing statistical test for Preference-shift

I am having trouble choosing the proper method to support my hypothesis. I have conducted an animal study, where subjects chose A or B, 6 times a day for 3 days (day 1~3). At first, I divided the ...
user avatar
2 votes
0 answers
98 views

How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
user avatar
0 votes
0 answers
10 views

Which test for a withinparticipant design with 2 categorical variables (with each participant having a value in each condition)

Design : two categorical variables. First : the independent variable : "type" with two conditions : intra & inter. Next, the measured variable : "consistance" with two ...
user avatar
0 votes
0 answers
15 views

deciphering between statistical tests

I want would like to test if the mean iron concentrations were higher at delivery time in the vaxx group compared to the placebo ,what hypothesis test would i use
user avatar
0 votes
0 answers
59 views

What kind of significance tests can I apply on before/after data that involves proportions?

I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages. There are two columns which show the ...
user avatar
  • 111
1 vote
2 answers
158 views

test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
user avatar
0 votes
1 answer
31 views

Test for pre-post test binary data for 3 groups

I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
user avatar
  • 1
0 votes
0 answers
11 views

Hypothesis test for the effectiveness of a binary classification tool

I am testing a tool for binary classification and am unsure what kind of null-hypothesis (and associated test) I should use to assess its effectiveness. In simplified terms, I have a data set of ...
user avatar
  • 1
2 votes
2 answers
99 views

Replacing McNemar test with regression?

Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)? Let's have a made-up example ...
user avatar
1 vote
0 answers
35 views

Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
user avatar
0 votes
1 answer
21 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
user avatar
  • 119
0 votes
0 answers
48 views

Conflicting McNemar chi square vs McNemar-Bowker interpretations

I am having a hard time understanding results between two tests that theoretically should be testing the same thing but seem to say something different. My study is of 180 subjects/farms that were ...
user avatar
0 votes
1 answer
30 views

McNemar exact DP test not running in R [closed]

I am unable to run the provided example (copy/pasted from here): ...
user avatar
1 vote
1 answer
153 views

In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?

In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results: ...
user avatar
0 votes
0 answers
47 views

Two categorical variables with many levels, dependent samples

I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
user avatar
0 votes
0 answers
32 views

Confusion matrix test-retest reliability (McNemar or paired t-test)

I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
user avatar
1 vote
0 answers
31 views

Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
user avatar
  • 11
0 votes
0 answers
30 views

Mcnemar's Test P-Value is equal to 1.00000

Good afternoon , I had trained a som classifier then i applied the classifier in a dataset of few rows ( ballons dataset from UCI repository ). ...
user avatar
  • 113
1 vote
2 answers
601 views

McNemar-Bowker exact test in R: difficulty interpreting the results

I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
user avatar
  • 23
1 vote
0 answers
141 views

Comparing two multi-class machine learning classifiers using Stuart Maxwell Test

I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps: obtain prediction on test data using ...
user avatar
  • 23
2 votes
1 answer
126 views

McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
user avatar
0 votes
1 answer
209 views

Stratification McNemar Test in R

I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc). What I need to know if ...
user avatar
  • 41
0 votes
0 answers
12 views

How to select dichotomous variables?

I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
user avatar
  • 2,680
1 vote
0 answers
207 views

When is "Cochran–Mantel–Haenszel" like "McNemar's test"?

In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
user avatar
0 votes
1 answer
300 views

Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)

Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
user avatar
1 vote
2 answers
67 views

Looking for an interaction between dichotomous variables with paired data using glmer in R

Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
user avatar
1 vote
0 answers
19 views

is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?

the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
user avatar
1 vote
1 answer
128 views

Interpretation of McNemar test example

In this tutorial https://learningstatisticswithr.com/book/chisquare.html in Example 12.8.1 I understand the result of the test ...
user avatar
  • 61
2 votes
0 answers
30 views

Analyze Repeated Measures of a Frequency

I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
user avatar
1 vote
0 answers
182 views

How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test

I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
user avatar
  • 224
1 vote
1 answer
118 views

Why McNemar is usually significant even in case of zero events on both sides?

After propensity score matching, we can assess balance between matched cohorts using McNemar test. I wonder why it is usually significant even in case of zero events on both sides. I saw prior ...
user avatar
3 votes
1 answer
88 views

If we use McNemar's for single case data, is pseudoreplication an issue?

I have a query about McNemar's test. As far as I understand, the technique assumes that cells are independent. It tends to be used with group studies whereby counts refer to individuals, for example a ...
user avatar
1 vote
0 answers
15 views

Comparing responses between groups and conditions

I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
user avatar
  • 11
0 votes
0 answers
64 views

Can I test the difference between two chi square statistics for significance

I'm working on a (currently) hypothetical problem that relates to monitoring and evaluating people's participation in recycling. The test statistic is the participation rate (the proportion of ...
user avatar
0 votes
1 answer
146 views

Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?

Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
user avatar
1 vote
0 answers
18 views

Chi2 versus other tests for dependent samples (same observer different time)

I have come across a problem at deciding which hypothesis test I should use. I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
user avatar
3 votes
1 answer
100 views

Is McNemar's Test Appropriate Here?

I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
user avatar
0 votes
0 answers
41 views

What Statistical Analysis test do I run for Pre/post test?

Hello I am conducting a study where I examine patients who have not received a flu vaccination. In all I have 45 participants all who have not received the vaccine. I implemented and educational ...
user avatar
  • 1
1 vote
1 answer
27 views

How to Test Sampling Methods

Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
user avatar
  • 111
2 votes
1 answer
267 views

Chi Square test or McNemar test?

I've got a set of 1000 patients and I am measuring two different blood values (CRP and IL6) and choosing a categorical cutoff values for both (CRP>10 and IL6 >2). I now would like to know if there is ...
user avatar
0 votes
0 answers
44 views

The McNemar exact conditional test: should the p-values be uniform under the null?

I have two classification models, $C_1$ and $C_2$, and I want to do a hypothesis test to see if $C_1$ is significantly better than $C_2$. I am interested in a one-sided hypothesis test. Thus I have ...
user avatar
  • 1,012
2 votes
1 answer
79 views

Another solution than McNemar test for bilateral asymmetry on binary data?

Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side. I need to test the ...
user avatar
  • 21
1 vote
1 answer
49 views

Statistical test for difference-hypothesis with dichotomous dependent and independent variables

I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
user avatar
1 vote
2 answers
104 views

What statistical test would I use to test that both data sources are matching [closed]

Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...
user avatar
0 votes
1 answer
75 views

Single Group Pre-Post McNemar Table Set Up

I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention. Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
user avatar
0 votes
1 answer
46 views

Chi-square based tests tending to zero for large sample sizes [duplicate]

I think I have some misconception about chi-square based tests such as Pearson's test or McNemar's test. The way the tests are defined, the test statistics produced by the formulas are not stable ...
user avatar
0 votes
0 answers
855 views

McNemar or Cochran's Q for evaluating multiclass classifiers?

full disclosure: I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other. tl;dr For ...
user avatar