Episode #125 of the Stack Overflow podcast is here. We talk Tilde Club and mechanical keyboards. Listen now

# Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

112 questions
Filter by
Sorted by
Tagged with
26 views

### Another solution than McNemar test for bilateral asymmetry on binary data?

Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side. I need to test the ...
300 views

### Is there a Bowker-like test to assess the symmetry of squared contingency tables with small expected values and a small number of observations?

I ask this question because Bowker test (McNemar extension for $k\times k$ tables with $k>2$) requires a large number of observations for fitting well and also requires (as a rule of thumb) that ...
17 views

### Statistical test for difference-hypothesis with dichotomous dependent and independent variables

I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
14 views

### Is it reasonable to do a test of marginal homogenity (mcnemar-bowker) when some combinations of the cells cannot possibly occur?

I have some patients that have none, mild and moderate form of a disease monitored at baseline and at 6-months. I would like to do the mcNemar-bowker test to see whether the drug given to everyone has ...
55 views

### What statistical test would I use to test that both data sources are matching [closed]

Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...
52 views

### NcNemar's test for 1:2 matched data

Does anyone use McNemar's test for fractional values after 1-to-2 propensity score matching? How correct would it be? For instance, let me have 0-1 outcomes and the following matched observations (...
205 views

### Which test to use? Repeated measures with binary outcomes

I would like your opinion about which analyses to use for the research question. I've got a repeated measures with binary data. N = 20 H0 = there is no difference between pre and post measurement ...
279 views

### Test if treatment effect is different between samples

I want to determine if there is significant variation in the effect of a treatment amongst my replicates. The treatment effect is measured as a proportion. Let me describe: I study heart defects (in ...
7 views

### When comparing classificators, is McNemar's test applied to the output or to the hits?

Suppose I have the following output, alongside the ground-truth ($GT$), for two classifiers $C_1$ and $C_2$: ...
26 views

### Single Group Pre-Post McNemar Table Set Up

I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention. Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
26 views

### Chi-square based tests tending to zero for large sample sizes [duplicate]

I think I have some misconception about chi-square based tests such as Pearson's test or McNemar's test. The way the tests are defined, the test statistics produced by the formulas are not stable ...
82 views

### McNemar or Cochran's Q for evaluating multiclass classifiers?

full disclosure: I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other. tl;dr For ...
124 views

### Difference in insight gained from Cohens' Kappa vs McNemar

I would like to understand the difference in what a test with Cohen's Kappa tells you about your data compared to what McNemar's test tells you. If Cohen's Kappa measures agreement between two ...
863 views

### One-sided McNemar's test

In R, the function mcnemar.test has the following example: ...
47 views

### Can I perform a McNemar's test with only proportion and denominator information?

I have the following count and denominator information. The 630 subjects are the same people over two different periods of time. Can I conduct a McNemar's test to compare the dependent proportion ...
286 views

### Paired binary data with a zero cell

How do you analyse and obtain a p-value from a 2*2 table examining a binary outcome that is paired, when one cell has zero events? To clarify, I was looking at the success rate of obtaining an ...
38 views

### Conditional Exact Logistic Regression

I have paired data for two tests. I would like to say that Test A is more sensitive than Best B, but not sure if I'm using the correct methods or if my data support it. I know McNemar's Exact test can ...
22 views

### Hypothesis testing with two dependent multilevel categorical variables [closed]

I was presented with a requirement of comparing two sources of diagnoses on the same subjects, resulting in two 4-level categorical variables. I offered to calculate Cohen's Kappa, but the interested ...
106 views

### Comparison of proportions using McNemar's Chi-Square using Pre- and Post- data for two disease conditions

This question follows-up on the post: What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each? I am examining a pre- and post- intervention data ...
69 views

### Multiple Observations per Subject per Time-point analysis?

I am having a difficult time finding an appropriate test for my analysis. Please help - In my study I have 130 participants who were tested with a binary outcome (pass [1] /fail [0]) before and ...
48 views

### comparing sensitivities

We want to compare two sampling methods. All patients will go through a DNA test for diagnosis(positive or negative). Then samples are taken to identify the determine the type of bacteria and ...
49 views

336 views

### How do I get an odds ratio with McNemar's test?

I have pre and post test data evaluating the effectiveness of a lesson about how to help friends who are being bullied. I am trying to see if more students know how to help a friend being bullied ...
4k views

### Fisher exact test on paired data

Given $40$ cases with lung cancer and $40$ matched controls (without lung cancer) (matching based on age, sex, etc.). To try to find evidence between the effect of smoking on lung cancer, I used ...
97 views

### Hypothesis test for intervention with class imbalance before intervention. Alternative to McNemar

I want to assess an intervention to cure a disease. An example is described by the following matrix: ...
6k views

### Importance of McNemar test in caret::confusionMatrix

There are many metrics to evaluate the performance of predictive model. Many of these appear relatively straightforward to me (e.g. Accuracy, Kappa, AUC-ROC, etc.) but I am uncertain regarding the ...
38 views

### Use of Chi Square for only semi-independent sample?

I ran a study for my Master's thesis that counted the number of people who attended different courses that were advertised in different ways, and how many passed/failed each. I used a Chi Square ...
705 views

### Mcnemar's test p-value output in R confusion matrix

I am using the R caret package to build a randomforest classifier model for plant data. The dataset has 7 variables - all numeric which are being used to predict if a plant will "grow" or "not grow"....
98 views

### How to Control Familywise Error Rate in a series of Planned McNemar Comparisons

I have paired binary responses from same subjects under 9 different conditions. I conducted Cochran's Q which indicated that there significantly different pairs exist. I want to follow up but NOT ...
500 views

### Can Cramér's V be used an effect size measure for McNemar's test?

I'm using McNemar's exact test (with R's "mcnemar.exact" function). I know that giving the odds ratio or proportion would be an adequate measure of effect size (Effect size of McNemar's Test), but ...
153 views

### Relationship between statistical models: mcnemar test vs logistic regression

I always find useful and reliable answers in this forum and I hope this pattern will not change this time. I was spending some time to check whether an intervention program had any effect on an ...
49 views

### Most appropriate test to assess difference between categorical variables? Chi2 or Stuart-Maxwell?

I am trying to determine the most appropriate test for parts of my dataset. I have been using a $\chi^2$ test, but I am now realising it might not be the most appropriate. I am using Stata. I have a ...
42k views

### What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each?

I have tried reading up on different sources, but I am still not clear what test would be the appropriate in my case. There are three different questions I am asking about my dataset: The subjects ...
256 views

### Sample size and number of events limitations for McNemar's test

What are sample size and number of events low limits for a proper application of McNemar's test with continuity correction? When must I use McNemar's exact test?
880 views

### Compare a diagnostic test to gold standard

I have a sample of patients who underwent 2 diagnostic tests, one of which is the gold standard. I've been asked to test if the diagnosis from the experimental test is different than the one from the ...
845 views

### McNemar or Fisher exact test for propensity score matched data?

I want to analyze some propensity score matched data. In the literature McNemar test is usually used, since the data is "paired". However matching is not pairing in the common sense. Would it be ...
83 views

### t-test/chi squarred test or mcnemar test?

To what extent does the effect of presence of music differ for the concentration ability in playing a memory recall game in males and females? So basically I had 50 students (25 females and 25 males) ...
155 views

### McNemar's test probably does not work, but what could?

I have a dataset of people who had back-to-back procedures and I have the whether or not polyps (precancerous lesions) removed during each procedure. ...
218 views

### McNemars Test Sample size calculation

I've searched for this particular question but i can't seem to find the right answer. Lets say i expect prob p01 = 0.2 and prob p10 = 0.3. I want a power of 0.8 and alpha of 0.05. This website: ...
2k views

### McNemar Test: Reporting Chi-Square?

I have performed a McNemar test for paired binomial variables in SPSS to see if the success rate(score 1) differs between the two conditions (the two variables: the before and after treatment ...
52 views

### Comparing “paired” proportions with different totals

I have long-term survey data for trees infected with a virus. The data was measured in 2000 and again in 2010. I'd like to compare the number of uninfected vs. infected trees in 2000 and 2010. However,...
3k views

### Fisher's exact test in 2x3 contingency table

I have a dataset with birds that were exposed to pesticides. The summary of this data looks like: ...
30 views

### Statistical test for testing different between groups in terms of efficiency in regression

During my thesis work I collected some measurements about chest compressions that reached a good depth (binomial data) during cardiopulmonary rescuscitaion (CPR), I have two groupes of volunteers and ...
66 views

### How to test difference of proportion in the same group of patients tested at two time points?

I have to calculate a sample size for a study in which patients are treated for a set period of time with a drug. Subsequently, responders are followed up (but not treated) for an additional period of ...
460 views

### Sample size determination for before/after study

I would like to estimate the required sample size for a study where I have subjects first undergo an observation (control) period of X months and then an intervention period of Y months. The outcome ...
4k views

### Determine if two proportions from the same sample are different

Is there a test I can use to compare two proportions from the same sample that are not mutually exclusive? For example, I would like see if the proportion of people that answered "yes" to a ...
122 views

### Does this meet the assumptions for McNemar's Test?

On the NIST page about McNemar's Test, the third listed assumption is that "The difference P(Xi = 0, Yi = 1) - P(Xi = 1, Yi = 0) is negative for all i or zero for all i or positive for all i." Let's ...
37 views

### Does sampling fraction matter for McNemar's Test?

For McNemar's Test, does the sample need to be less than 1/20 of the population if the sample is without replacement? If so, can I correct for a sample that is larger than 1/20 of the population by ...