Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
0 votes
1 answer
39 views

Chi-squared for repeated measures for 2 by n

I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
  • 179
0 votes
0 answers
25 views

Infinite odds ratio

I tested 100 samples using two tests (each sample receIved to tests in parallel). I want to see if there is a significant difference between the occurance of invalid tests from the two tests. My ...
  • 1
1 vote
1 answer
61 views

McNemar test or Two proportion z-test?

Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is: Is there a difference between ...
  • 13
1 vote
0 answers
34 views

What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?

I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
  • 21
0 votes
0 answers
61 views

How to interpret high P-value and low Mcnemar's Test P-value in Caret R?

I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
  • 121
2 votes
1 answer
30 views

Statistical test for PCR and bacterial culture with two different testing methods

I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
2 votes
0 answers
41 views

Confused about interpretation and intuition behind Mcnemar's Test [duplicate]

I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
  • 21
0 votes
0 answers
79 views

Choosing statistical test for Preference-shift

I am having trouble choosing the proper method to support my hypothesis. I have conducted an animal study, where subjects chose A or B, 6 times a day for 3 days (day 1~3). At first, I divided the ...
2 votes
0 answers
103 views

How to test if watching a advertisement only 1 time is enough to change one's preference

I'm sort of having a trouble finding what statistical test to use in a specific project of mine. My experiment was as follows: I have 10 friends and they all prefer Coke cola then Pepsi. Each of them ...
0 votes
0 answers
15 views

Which test for a withinparticipant design with 2 categorical variables (with each participant having a value in each condition)

Design : two categorical variables. First : the independent variable : "type" with two conditions : intra & inter. Next, the measured variable : "consistance" with two ...
0 votes
0 answers
17 views

deciphering between statistical tests

I want would like to test if the mean iron concentrations were higher at delivery time in the vaxx group compared to the placebo ,what hypothesis test would i use
's user avatar
0 votes
0 answers
62 views

What kind of significance tests can I apply on before/after data that involves proportions?

I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages. There are two columns which show the ...
  • 111
1 vote
2 answers
199 views

test of significance for two groups of classification results

I will edit this question for more specific questions. I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
0 votes
1 answer
62 views

Test for pre-post test binary data for 3 groups

I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
  • 1
0 votes
0 answers
16 views

Hypothesis test for the effectiveness of a binary classification tool

I am testing a tool for binary classification and am unsure what kind of null-hypothesis (and associated test) I should use to assess its effectiveness. In simplified terms, I have a data set of ...
  • 1
3 votes
2 answers
169 views

Replacing McNemar test with regression?

Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)? Let's have a made-up example ...
1 vote
0 answers
70 views

Alternatives to Chi-square test when observations are dependent

I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
0 votes
1 answer
48 views

Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)

For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
  • 119
0 votes
1 answer
67 views

McNemar exact DP test not running in R [closed]

I am unable to run the provided example (copy/pasted from here): ...
1 vote
1 answer
204 views

In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?

In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results: ...
0 votes
0 answers
58 views

Two categorical variables with many levels, dependent samples

I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
0 votes
0 answers
51 views

Confusion matrix test-retest reliability (McNemar or paired t-test)

I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1 vote
0 answers
31 views

Which Statistical Hypothesis Test is appropriate Here?

I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis. The data was ...
  • 11
1 vote
2 answers
902 views

McNemar-Bowker exact test in R: difficulty interpreting the results

I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
  • 23
1 vote
0 answers
182 views

Comparing two multi-class machine learning classifiers using Stuart Maxwell Test

I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps: obtain prediction on test data using ...
  • 23
2 votes
1 answer
178 views

McNemar's for 1:N Matched Pairs (for N>1)

Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible. Each case is ...
0 votes
1 answer
276 views

Stratification McNemar Test in R

I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc). What I need to know if ...
  • 41
0 votes
0 answers
13 views

How to select dichotomous variables?

I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
  • 2,690
1 vote
0 answers
260 views

When is "Cochran–Mantel–Haenszel" like "McNemar's test"?

In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
  • 20.4k
1 vote
1 answer
458 views

Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)

Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
  • 20.4k
1 vote
2 answers
73 views

Looking for an interaction between dichotomous variables with paired data using glmer in R

Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
1 vote
0 answers
20 views

is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?

the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
1 vote
1 answer
169 views

Interpretation of McNemar test example

In this tutorial https://learningstatisticswithr.com/book/chisquare.html in Example 12.8.1 I understand the result of the test ...
  • 61
2 votes
0 answers
40 views

Analyze Repeated Measures of a Frequency

I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
1 vote
0 answers
236 views

How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test

I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
  • 184
2 votes
1 answer
161 views

Why McNemar is usually significant even in case of zero events on both sides?

After propensity score matching, we can assess balance between matched cohorts using McNemar test. I wonder why it is usually significant even in case of zero events on both sides. I saw prior ...
3 votes
1 answer
100 views

If we use McNemar's for single case data, is pseudoreplication an issue?

I have a query about McNemar's test. As far as I understand, the technique assumes that cells are independent. It tends to be used with group studies whereby counts refer to individuals, for example a ...
1 vote
0 answers
15 views

Comparing responses between groups and conditions

I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
  • 11
0 votes
0 answers
79 views

Can I test the difference between two chi square statistics for significance

I'm working on a (currently) hypothetical problem that relates to monitoring and evaluating people's participation in recycling. The test statistic is the participation rate (the proportion of ...
0 votes
1 answer
162 views

Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?

Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
1 vote
0 answers
18 views

Chi2 versus other tests for dependent samples (same observer different time)

I have come across a problem at deciding which hypothesis test I should use. I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
3 votes
2 answers
161 views

Is McNemar's Test Appropriate Here?

I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
's user avatar
0 votes
0 answers
61 views

What Statistical Analysis test do I run for Pre/post test?

Hello I am conducting a study where I examine patients who have not received a flu vaccination. In all I have 45 participants all who have not received the vaccine. I implemented and educational ...
  • 1
1 vote
1 answer
28 views

How to Test Sampling Methods

Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
  • 111
2 votes
1 answer
316 views

Chi Square test or McNemar test?

I've got a set of 1000 patients and I am measuring two different blood values (CRP and IL6) and choosing a categorical cutoff values for both (CRP>10 and IL6 >2). I now would like to know if there is ...
0 votes
0 answers
46 views

The McNemar exact conditional test: should the p-values be uniform under the null?

I have two classification models, $C_1$ and $C_2$, and I want to do a hypothesis test to see if $C_1$ is significantly better than $C_2$. I am interested in a one-sided hypothesis test. Thus I have ...
  • 1,042
2 votes
1 answer
85 views

Another solution than McNemar test for bilateral asymmetry on binary data?

Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side. I need to test the ...
  • 21
1 vote
1 answer
51 views

Statistical test for difference-hypothesis with dichotomous dependent and independent variables

I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
2 votes
1 answer
958 views

Repeated-measure contingency table with two variables with many levels?

I am trying to analyze the results of a survey on what would make people of different ages visit certain tourist places. However, age was collected as age-group (not my fault). Hence, it is a ...
  • 21
1 vote
2 answers
126 views

What statistical test would I use to test that both data sources are matching [closed]

Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...