Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
1
vote
1answer
489 views

Sample size and number of events limitations for McNemar's test

What are sample size and number of events low limits for a proper application of McNemar's test with continuity correction? When must I use McNemar's exact test?
5
votes
2answers
2k views

Compare a diagnostic test to gold standard

I have a sample of patients who underwent 2 diagnostic tests, one of which is the gold standard. I've been asked to test if the diagnosis from the experimental test is different than the one from the ...
7
votes
1answer
1k views

McNemar or Fisher exact test for propensity score matched data?

I want to analyze some propensity score matched data. In the literature McNemar test is usually used, since the data is "paired". However matching is not pairing in the common sense. Would it be ...
1
vote
2answers
101 views

t-test/chi squarred test or mcnemar test?

To what extent does the effect of presence of music differ for the concentration ability in playing a memory recall game in males and females? So basically I had 50 students (25 females and 25 males) ...
3
votes
2answers
183 views

McNemar's test probably does not work, but what could?

I have a dataset of people who had back-to-back procedures and I have the whether or not polyps (precancerous lesions) removed during each procedure. ...
2
votes
1answer
549 views

McNemars Test Sample size calculation

I've searched for this particular question but i can't seem to find the right answer. Lets say i expect prob p01 = 0.2 and prob p10 = 0.3. I want a power of 0.8 and alpha of 0.05. This website: ...
1
vote
1answer
2k views

McNemar Test: Reporting Chi-Square?

I have performed a McNemar test for paired binomial variables in SPSS to see if the success rate(score 1) differs between the two conditions (the two variables: the before and after treatment ...
1
vote
0answers
57 views

Comparing “paired” proportions with different totals

I have long-term survey data for trees infected with a virus. The data was measured in 2000 and again in 2010. I'd like to compare the number of uninfected vs. infected trees in 2000 and 2010. However,...
2
votes
1answer
4k views

Fisher's exact test in 2x3 contingency table

I have a dataset with birds that were exposed to pesticides. The summary of this data looks like: ...
1
vote
0answers
32 views

Statistical test for testing different between groups in terms of efficiency in regression

During my thesis work I collected some measurements about chest compressions that reached a good depth (binomial data) during cardiopulmonary rescuscitaion (CPR), I have two groupes of volunteers and ...
0
votes
1answer
79 views

How to test difference of proportion in the same group of patients tested at two time points?

I have to calculate a sample size for a study in which patients are treated for a set period of time with a drug. Subsequently, responders are followed up (but not treated) for an additional period of ...
1
vote
0answers
696 views

Sample size determination for before/after study

I would like to estimate the required sample size for a study where I have subjects first undergo an observation (control) period of X months and then an intervention period of Y months. The outcome ...
3
votes
2answers
5k views

Determine if two proportions from the same sample are different

Is there a test I can use to compare two proportions from the same sample that are not mutually exclusive? For example, I would like see if the proportion of people that answered "yes" to a ...
1
vote
0answers
128 views

Does this meet the assumptions for McNemar's Test?

On the NIST page about McNemar's Test, the third listed assumption is that "The difference P(Xi = 0, Yi = 1) - P(Xi = 1, Yi = 0) is negative for all i or zero for all i or positive for all i." Let's ...
3
votes
0answers
38 views

Does sampling fraction matter for McNemar's Test?

For McNemar's Test, does the sample need to be less than 1/20 of the population if the sample is without replacement? If so, can I correct for a sample that is larger than 1/20 of the population by ...
0
votes
1answer
80 views

What would be appropriate test to compare two lists of dichotomous variables?

Colleagues, can't wrap my mind on simple question, please help! I have two products and list of their attributes. My respondents make an answer which product on each attribute they prefer. Finally ...
2
votes
2answers
570 views

How to get random classification to assess the performance of classifier with McNemar test?

I'm trying to replicate a study where the author used the McNemar test to assess the performance of classification compared to random classification. I have the original classifier and I'm using R to ...
4
votes
1answer
572 views

Contingency table for gene groups

I have two lists of genes as follows: DEList has 282 gene names AllList has 32805 gene names ...
0
votes
1answer
249 views

McNemar or z-test?

I'm doing a matched sample evaluation to see if there is a statistical difference in graduation rates at a college for total sample and sub-groups within the sample after a policy change intended to ...
2
votes
1answer
264 views

What is the Bayesian counterpart to the McNemar test (of marginal homogeneity)?

In analogy to a similar post on continuous data, I ask the following. In paired discrete data, we test the frequentist hypothesis of equivalent marginal distributions of two discrete variables $X$ and ...
0
votes
1answer
113 views

Bayes Factors for McNemar Test

I am currently analyzing data from a within-subjects study in which all participants completed a standard and experimental task. Responses were binary (pass = 1; fail = 0). I believe that the ...
2
votes
1answer
807 views

comparing proportions before and after two different interventions

I am trying to compare the proportions before and after TWO interventions in a small sample. Basically, 10 people had intervention A, and I want to compare proportions of their success rate before ...
1
vote
0answers
576 views

McNemar test for three groups

I'm trying to examine the difference in proportions of outcomes from three different tests (positive, negative, unsure). I want to compare what proportions of outcomes is positive for each test. All ...
2
votes
1answer
998 views

Comparing two decision models using McNemar's test

I'm trying to compare the performance of two classification algorithms. Thanks to CrossValidated, I already know that the best way to do this is via McNemar's test. I performed this, and sure enough, ...
1
vote
2answers
327 views

McNemar's test with combined cell values?

I have 313 males and 356 females. Males and females each took two (gender specific) surveys (an original and a modified version). The survey I'm investigating is a measure of unwanted sexual ...
1
vote
0answers
247 views

Conditional logistic regression: within subject matching instead of McNemar [duplicate]

I'm trying to compare the prevalence of a specific lesion (binary) at the symptomatic side to the asymptomatic side within a group of patients. I've already performed a McNemar test to compare the ...
1
vote
0answers
65 views

Comparing the performance of random and weighted-random classifiers

I have a set of 300 observations of known class and there are 20 classes in total. I want to compare the performance of a random classifier with a weighted-random classifier at classifying the ...
2
votes
1answer
1k views

McNemar test with multiple scores for the same subject

I am having a statistical issue: subjects receive a test with machine A and machine B. 3 experts classify whether the results of machine A and machine B are acceptable (1) or not (0). From my ...
3
votes
0answers
1k views

Chi-square test vs. McNemar's test - which test is right for this highly usual situation?

Friends, Here is, I would assume, a fairly common situation: I would like to know which test to use to assess whether the tendency to answer "Yes" on question 1 of a questionnaire is associated with ...
3
votes
0answers
474 views

Pearson's chi-squared test assumption: independence of observations

I am unsure of how to establish (or interpret) the independence condition of the chi-squared test in (for instance) the following situation. Consider this 2x2 contingency table representing the ...
1
vote
1answer
800 views

mcNemar's Test how to compare two proportions in dependent sample

I would like to compare the false positive rates (1 - specificity) from two different tests within the same sample. The false positive rate is calculated by comparing the test values against the ...
1
vote
1answer
101 views

Site interaction with McNemar tests [closed]

I have some clinical diagnostic data from three sites that I have been looking at performance against a reference standard using the McNemar test. How would I set up the analysis to investigate if ...
1
vote
2answers
3k views

Which test to choose when Wilcoxon test and McNemar's test are different?

I have paired data.The response variable is categorical with levels 1-5. And I have used both McNemar's test and Wilcoxon rank sign test and I get different p-values. For McNemar's test a p-value of 0....
2
votes
2answers
1k views

McNemar's test p-value NA

I have paired data from 9 individuals. The response variable is ordinal with levels 1-5. As the sample is very small and the data are categorical, I thought the appropriate test was McNemar's test. ...
1
vote
0answers
1k views

Alternatives to McNemar-Bowker test when symmetrical cells have zero count in contingency matrix

I need to test the difference between pre- and post- intervention over a 4-grades parameter computed on 57 samples. The contingency matrix on which I need to compute a McNemar test for paired data (...
1
vote
1answer
178 views

Appropriate statistic for testing similarity of two paired binary datasets (of glaciovolcanism)

I am studying the ice-covered volcanoes of the world. I have developed three methods that use existing datasets to determine whether a particular volcano is icy or not, and I applied all three methods ...
1
vote
1answer
65 views

Statistically significance test to compare a ML classifier to a group of experts?

I am working on a medical data set of 60 test samples and I have the decisions of 45 medical experts for them over 5 diagnostic classes. How should I do hypothesis testing to show that the classifier ...
1
vote
0answers
186 views

Test for paired data on categorical variable with >2 levels

I am looking for the appropriate statistical test to compare frequencies over a categorical variable with >2 classes, for paired data (in practice, each individual has been labelled A, B, C or D ...
3
votes
1answer
1k views

McNemar's test vs chi-squared test for before & after data with different people from the same population

I have 2 proportions I want to compare. They are from the same population but at different time periods, in between which there was an intervention. H0: Proportion in Period#1 = Proportion in Period#...
2
votes
1answer
318 views

McNemar test comparing two proportions in a crossover trial

In a crossover trial involving 50 patients, two dialysis treatment schedules were compared.Ten patients complained of vomiting on both schedules, 30 on neither, nine on treatment A only and one on ...
2
votes
1answer
144 views

Test for pairs of small integers

I have two classifiers, say $A$ and $B$ and I am performing 10$\times$10-fold cross-validation on them and record the number of instances correctly classified from the test set. Unfortunately, the ...
3
votes
1answer
841 views

Why Yates correction in McNemar's Test subtract 1?

McNemar's test statistic is given by: Yates's correction defines something like this: However, the correction for the McNemar's test statistic requires 1 (not 0.5)...
1
vote
1answer
1k views

McNemar or chi-square - test for group differences paired and unpaired data

I understand that the difference between a chi-square test of homogeneity and the McNemar test is that the chi square is used for unpaired data and the McNemar is used for paire data. Here's my ...
1
vote
0answers
126 views

Comparing binomial outcomes from prediction algorithms in R

I've written a simple model to predict the outcome of soccer games based on some input. The outcome is either "H","D",or "A", short for home team, away team, or draw. I'm comparing the results of this ...
2
votes
0answers
450 views

Can Cochran's Q test take a 3 level nominal variable as the response (instead of 2)?

I conducted a study using within-subjects (repeated measure) design for collecting nominal data. I have been reading a lot closet I get for a suitable test is Cochran's Q test since I have repeated ...
6
votes
3answers
737 views

Why aren't the diagonal counts used in McNemar's test?

In reviewing McNemar's test, I see that the diagonal counts aren't used in computing the test statistic. However, since the test is testing the null that the row and column marginals are equal, ...
1
vote
0answers
49 views

Can I sum up my count data instead of performing some repeated measures analysis?

I want to analyze establishment of plants in created gaps (plots): I have 10 treated plots, which are divided into an outer section and an inner one and I have been looking at these plots over a ...
1
vote
0answers
1k views

Statistical test for paired data in an r x c contingency table

To perform statistical test on paired data when we have two dichotomous nominal variables (i.e., in a 2 x 2 contingency table) we can use the McNemar's test. When ...
1
vote
0answers
29 views

Self-selected groups categorical breakdown test

I have a population of people, and one group who was self-selected (group A), and the remainder of the population (group B), and each group is broken into a group of n nominal categories (categories ...
2
votes
1answer
564 views

Analyzing multiple dependent pairs of 2x2 contingency tables

In advance, I ask forgiveness for my statistical naïvety. Suppose I have experimental data from pre- and post-treatment, and this data is split according to two binary categories like so: \begin{...