Questions tagged [mcnemar-test]
A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.
0
votes
0answers
5 views
When comparing classificators, is McNemar's test applied to the output or to the hits?
Suppose I have the following output, alongside the ground-truth ($GT$), for two classifiers $C_1$ and $C_2$:
...
0
votes
1answer
22 views
Single Group Pre-Post McNemar Table Set Up
I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention.
Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
0
votes
1answer
23 views
Chi-square based tests tending to zero for large sample sizes [duplicate]
I think I have some misconception about chi-square based tests such as Pearson's test or McNemar's test. The way the tests are defined, the test statistics produced by the formulas are not stable ...
0
votes
0answers
48 views
McNemar or Cochran's Q for evaluating multiclass classifiers?
full disclosure:
I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other.
tl;dr
For ...
0
votes
0answers
83 views
Difference in insight gained from Cohens' Kappa vs McNemar
I would like to understand the difference in what a test with Cohen's Kappa tells you about your data compared to what McNemar's test tells you.
If Cohen's Kappa measures agreement between two ...
3
votes
1answer
41 views
Can I perform a McNemar's test with only proportion and denominator information?
I have the following count and denominator information. The 630 subjects are the same people over two different periods of time. Can I conduct a McNemar's test to compare the dependent proportion ...
0
votes
1answer
31 views
Conditional Exact Logistic Regression
I have paired data for two tests. I would like to say that Test A is more sensitive than Best B, but not sure if I'm using the correct methods or if my data support it. I know McNemar's Exact test can ...
1
vote
0answers
22 views
Hypothesis testing with two dependent multilevel categorical variables [closed]
I was presented with a requirement of comparing two sources of diagnoses on the same subjects, resulting in two 4-level categorical variables. I offered to calculate Cohen's Kappa, but the interested ...
1
vote
1answer
42 views
Multiple Observations per Subject per Time-point analysis?
I am having a difficult time finding an appropriate test for my analysis. Please help -
In my study I have 130 participants who were tested with a binary outcome (pass [1] /fail [0]) before and ...
1
vote
1answer
93 views
Comparison of proportions using McNemar's Chi-Square using Pre- and Post- data for two disease conditions
This question follows-up on the post: What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each?
I am examining a pre- and post- intervention data ...
0
votes
0answers
32 views
comparing sensitivities
We want to compare two sampling methods. All patients will go through a DNA test for diagnosis(positive or negative). Then samples are taken to identify the determine the type of bacteria and ...
0
votes
1answer
33 views
Comparing proportions from overlapping samples
I'm looking to compare the read rate of an email newsletter with the read rate of another newsletter. However, many (not all) of the people who receive one newsletter also receive the other. What ...
1
vote
0answers
241 views
How do I get an odds ratio with McNemar's test?
I have pre and post test data evaluating the effectiveness of a lesson about how to help friends who are being bullied. I am trying to see if more students know how to help a friend being bullied ...
2
votes
3answers
85 views
Hypothesis test for intervention with class imbalance before intervention. Alternative to McNemar
I want to assess an intervention to cure a disease. An example is described by the following matrix:
...
0
votes
0answers
46 views
One-tailed test for comparing paired dichotomous responses
Given reference samples $R_i$, I have two dichotomous responses $X_i$ and $Y_i$ I wish to compare. Each dichotomous response (relevant vs. irrelevant to the reference $R_i$) is generated by an ...
0
votes
0answers
26 views
Which test to use when comparing diagnostic performance of doctors with and without a computer assisted diagnostic support tool?
This will seem very basic so my apologies.
Lets say I have 10 doctors who are inexperienced diagnosing cancer in 100 patients. 50 patients have cancer and the other 50 do not. The doctors provide a ...
0
votes
2answers
74 views
How to Control Familywise Error Rate in a series of Planned McNemar Comparisons
I have paired binary responses from same subjects under 9 different conditions. I conducted Cochran's Q which indicated that there significantly different pairs exist. I want to follow up but NOT ...
5
votes
2answers
355 views
Can Cramér's V be used an effect size measure for McNemar's test?
I'm using McNemar's exact test (with R's "mcnemar.exact" function). I know that giving the odds ratio or proportion would be an adequate measure of effect size (Effect size of McNemar's Test), but ...
0
votes
1answer
130 views
Relationship between statistical models: mcnemar test vs logistic regression
I always find useful and reliable answers in this forum and I hope this pattern will not change this time.
I was spending some time to check whether an intervention program had any effect on an ...
1
vote
2answers
43 views
Most appropriate test to assess difference between categorical variables? Chi2 or Stuart-Maxwell?
I am trying to determine the most appropriate test for parts of my dataset. I have been using a $\chi^2$ test, but I am now realising it might not be the most appropriate. I am using Stata.
I have a ...
1
vote
1answer
177 views
Sample size and number of events limitations for McNemar's test
What are sample size and number of events low limits for a proper application of McNemar's test with continuity correction? When must I use McNemar's exact test?
1
vote
1answer
36 views
Use of Chi Square for only semi-independent sample?
I ran a study for my Master's thesis that counted the number of people who attended different courses that were advertised in different ways, and how many passed/failed each. I used a Chi Square ...
5
votes
2answers
653 views
Compare a diagnostic test to gold standard
I have a sample of patients who underwent 2 diagnostic tests, one of which is the gold standard. I've been asked to test if the diagnosis from the experimental test is different than the one from the ...
7
votes
1answer
794 views
McNemar or Fisher exact test for propensity score matched data?
I want to analyze some propensity score matched data. In the literature McNemar test is usually used, since the data is "paired". However matching is not pairing in the common sense.
Would it be ...
0
votes
1answer
566 views
Mcnemar's test p-value output in R confusion matrix
I am using the R caret package to build a randomforest classifier model for plant data.
The dataset has 7 variables - all numeric which are being used to predict if a plant will "grow" or "not grow"....
1
vote
2answers
71 views
t-test/chi squarred test or mcnemar test?
To what extent does the effect of presence of music differ for the concentration ability in playing a memory recall game in males and females?
So basically I had 50 students (25 females and 25 males) ...
3
votes
2answers
136 views
McNemar's test probably does not work, but what could?
I have a dataset of people who had back-to-back procedures and I have the whether or not polyps (precancerous lesions) removed during each procedure.
...
2
votes
1answer
708 views
2
votes
1answer
169 views
McNemars Test Sample size calculation
I've searched for this particular question but i can't seem to find the right answer.
Lets say i expect prob p01 = 0.2 and prob p10 = 0.3. I want a power of 0.8 and alpha of 0.05.
This website:
...
1
vote
0answers
48 views
Comparing “paired” proportions with different totals
I have long-term survey data for trees infected with a virus. The data was measured in 2000 and again in 2010. I'd like to compare the number of uninfected vs. infected trees in 2000 and 2010. However,...
1
vote
1answer
3k views
Fisher's exact test in 2x3 contingency table
I have a dataset with birds that were exposed to pesticides. The summary of this data looks like:
...
1
vote
1answer
232 views
Paired binary data with a zero cell
How do you analyse and obtain a p-value from a 2*2 table examining a binary outcome that is paired, when one cell has zero events?
To clarify, I was looking at the success rate of obtaining an ...
1
vote
0answers
30 views
Statistical test for testing different between groups in terms of efficiency in regression
During my thesis work I collected some measurements about chest compressions that reached a good depth (binomial data) during cardiopulmonary rescuscitaion (CPR), I have two groupes of volunteers and ...
0
votes
1answer
65 views
How to test difference of proportion in the same group of patients tested at two time points?
I have to calculate a sample size for a study in which patients are treated for a set period of time with a drug. Subsequently, responders are followed up (but not treated) for an additional period of ...
1
vote
0answers
360 views
Sample size determination for before/after study
I would like to estimate the required sample size for a study where I have subjects first undergo an observation (control) period of X months and then an intervention period of Y months. The outcome ...
1
vote
0answers
118 views
Does this meet the assumptions for McNemar's Test?
On the NIST page about McNemar's Test, the third listed assumption is that "The difference P(Xi = 0, Yi = 1) - P(Xi = 1, Yi = 0) is negative for all i or zero for all i or positive for all i."
Let's ...
3
votes
0answers
36 views
Does sampling fraction matter for McNemar's Test?
For McNemar's Test, does the sample need to be less than 1/20 of the population if the sample is without replacement? If so, can I correct for a sample that is larger than 1/20 of the population by ...
0
votes
1answer
73 views
What would be appropriate test to compare two lists of dichotomous variables?
Colleagues, can't wrap my mind on simple question, please help!
I have two products and list of their attributes. My respondents make an answer which product on each attribute they prefer. Finally ...
0
votes
1answer
160 views
McNemar or z-test?
I'm doing a matched sample evaluation to see if there is a statistical difference in graduation rates at a college for total sample and sub-groups within the sample after a policy change intended to ...
1
vote
1answer
1k views
McNemar Test: Reporting Chi-Square?
I have performed a McNemar test for paired binomial variables in SPSS to see if the success rate(score 1) differs between the two conditions (the two variables: the before and after treatment ...
2
votes
1answer
549 views
comparing proportions before and after two different interventions
I am trying to compare the proportions before and after TWO interventions in a small sample.
Basically, 10 people had intervention A, and I want to compare proportions of their success rate before ...
1
vote
0answers
379 views
McNemar test for three groups
I'm trying to examine the difference in proportions of outcomes from three different tests (positive, negative, unsure). I want to compare what proportions of outcomes is positive for each test. All ...
1
vote
1answer
565 views
Comparing two decision models using McNemar's test
I'm trying to compare the performance of two classification algorithms. Thanks to CrossValidated, I already know that the best way to do this is via McNemar's test. I performed this, and sure enough, ...
0
votes
1answer
107 views
What test to use to compare two distributions (from the same group of people)?
I have a data that consists of some "after treatment" and "before treatment" observations from some individuals.
Specifically the data looks like this:
...
1
vote
0answers
216 views
Conditional logistic regression: within subject matching instead of McNemar [duplicate]
I'm trying to compare the prevalence of a specific lesion (binary) at the symptomatic side to the asymptomatic side within a group of patients.
I've already performed a McNemar test to compare the ...
1
vote
0answers
57 views
Comparing the performance of random and weighted-random classifiers
I have a set of 300 observations of known class and there are 20 classes in total.
I want to compare the performance of a random classifier with a weighted-random classifier at classifying the ...
0
votes
1answer
81 views
Bayes Factors for McNemar Test
I am currently analyzing data from a within-subjects study in which all participants completed a standard and experimental task.
Responses were binary (pass = 1; fail = 0).
I believe that the ...
2
votes
1answer
191 views
What is the Bayesian counterpart to the McNemar test (of marginal homogeneity)?
In analogy to a similar post on continuous data, I ask the following. In paired discrete data, we test the frequentist hypothesis of equivalent marginal distributions of two discrete variables $X$ and ...
1
vote
1answer
921 views
McNemar test with multiple scores for the same subject
I am having a statistical issue:
subjects receive a test with machine A and machine B.
3 experts classify whether the results of machine A and machine B are acceptable (1) or not (0).
From my ...
1
vote
0answers
427 views
comparing classifers using McNemar Test
When comparing performance of two binary classifiers using McNemar test, should the two confusion matrices of the models be based on the training set, the validation set or even a second validation ...
