Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

45 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
37 views

Does sampling fraction matter for McNemar's Test?

For McNemar's Test, does the sample need to be less than 1/20 of the population if the sample is without replacement? If so, can I correct for a sample that is larger than 1/20 of the population by ...
3
votes
0answers
1k views

Chi-square test vs. McNemar's test - which test is right for this highly usual situation?

Friends, Here is, I would assume, a fairly common situation: I would like to know which test to use to assess whether the tendency to answer "Yes" on question 1 of a questionnaire is associated with ...
3
votes
0answers
428 views

Pearson's chi-squared test assumption: independence of observations

I am unsure of how to establish (or interpret) the independence condition of the chi-squared test in (for instance) the following situation. Consider this 2x2 contingency table representing the ...
3
votes
0answers
121 views

Does conditional logistic regression effectively “throw away” concordant pairs like McNemar's test?

We are interested in analyzing pre-post data from a randomized control trial. The outcome is binary and I am trying to explain the heuristics of the model formulation for conditional logistic ...
2
votes
1answer
188 views

Which test to use? Repeated measures with binary outcomes

I would like your opinion about which analyses to use for the research question. I've got a repeated measures with binary data. N = 20 H0 = there is no difference between pre and post measurement ...
2
votes
0answers
365 views

Can Cochran's Q test take a 3 level nominal variable as the response (instead of 2)?

I conducted a study using within-subjects (repeated measure) design for collecting nominal data. I have been reading a lot closet I get for a suitable test is Cochran's Q test since I have repeated ...
2
votes
1answer
294 views

Is there a Bowker-like test to assess the symmetry of squared contingency tables with small expected values and a small number of observations?

I ask this question because Bowker test (McNemar extension for $k\times k$ tables with $k>2$) requires a large number of observations for fitting well and also requires (as a rule of thumb) that ...
2
votes
0answers
218 views

Comparison of multiple diagnostic tests with paired data

Good Day All, I am attempting to compare three diagnostic tests against a gold-standard and for simplicity sake, let us have all the outcomes be binary (disease/no disease). In this study study, all ...
2
votes
0answers
253 views

Comparing proportions from the (somewhat) same sample

I’m looking for some help on testing whether there are statistical differences between proportions when the data is dependent. By dependent, I mean that all the data is from the same participants ...
1
vote
0answers
284 views

How do I get an odds ratio with McNemar's test?

I have pre and post test data evaluating the effectiveness of a lesson about how to help friends who are being bullied. I am trying to see if more students know how to help a friend being bullied ...
1
vote
0answers
50 views

Comparing “paired” proportions with different totals

I have long-term survey data for trees infected with a virus. The data was measured in 2000 and again in 2010. I'd like to compare the number of uninfected vs. infected trees in 2000 and 2010. However,...
1
vote
0answers
30 views

Statistical test for testing different between groups in terms of efficiency in regression

During my thesis work I collected some measurements about chest compressions that reached a good depth (binomial data) during cardiopulmonary rescuscitaion (CPR), I have two groupes of volunteers and ...
1
vote
0answers
398 views

Sample size determination for before/after study

I would like to estimate the required sample size for a study where I have subjects first undergo an observation (control) period of X months and then an intervention period of Y months. The outcome ...
1
vote
0answers
119 views

Does this meet the assumptions for McNemar's Test?

On the NIST page about McNemar's Test, the third listed assumption is that "The difference P(Xi = 0, Yi = 1) - P(Xi = 1, Yi = 0) is negative for all i or zero for all i or positive for all i." Let's ...
1
vote
0answers
395 views

McNemar test for three groups

I'm trying to examine the difference in proportions of outcomes from three different tests (positive, negative, unsure). I want to compare what proportions of outcomes is positive for each test. All ...
1
vote
0answers
57 views

Comparing the performance of random and weighted-random classifiers

I have a set of 300 observations of known class and there are 20 classes in total. I want to compare the performance of a random classifier with a weighted-random classifier at classifying the ...
1
vote
0answers
433 views

comparing classifers using McNemar Test

When comparing performance of two binary classifiers using McNemar test, should the two confusion matrices of the models be based on the training set, the validation set or even a second validation ...
1
vote
1answer
274 views

Test if treatment effect is different between samples

I want to determine if there is significant variation in the effect of a treatment amongst my replicates. The treatment effect is measured as a proportion. Let me describe: I study heart defects (in ...
1
vote
0answers
965 views

Alternatives to McNemar-Bowker test when symmetrical cells have zero count in contingency matrix

I need to test the difference between pre- and post- intervention over a 4-grades parameter computed on 57 samples. The contingency matrix on which I need to compute a McNemar test for paired data (...
1
vote
1answer
62 views

Statistically significance test to compare a ML classifier to a group of experts?

I am working on a medical data set of 60 test samples and I have the decisions of 45 medical experts for them over 5 diagnostic classes. How should I do hypothesis testing to show that the classifier ...
1
vote
0answers
155 views

Test for paired data on categorical variable with >2 levels

I am looking for the appropriate statistical test to compare frequencies over a categorical variable with >2 classes, for paired data (in practice, each individual has been labelled A, B, C or D ...
1
vote
0answers
115 views

Comparing binomial outcomes from prediction algorithms in R

I've written a simple model to predict the outcome of soccer games based on some input. The outcome is either "H","D",or "A", short for home team, away team, or draw. I'm comparing the results of this ...
1
vote
0answers
43 views

Can I sum up my count data instead of performing some repeated measures analysis?

I want to analyze establishment of plants in created gaps (plots): I have 10 treated plots, which are divided into an outer section and an inner one and I have been looking at these plots over a ...
1
vote
0answers
950 views

Statistical test for paired data in an r x c contingency table

To perform statistical test on paired data when we have two dichotomous nominal variables (i.e., in a 2 x 2 contingency table) we can use the McNemar's test. When ...
1
vote
0answers
27 views

Self-selected groups categorical breakdown test

I have a population of people, and one group who was self-selected (group A), and the remainder of the population (group B), and each group is broken into a group of n nominal categories (categories ...
1
vote
0answers
75 views

dependent samples, binary data, multiple tests?

In each of my five experiments I run several trials which give me a certain success rate (e.g. 10 successful trials out of 30 tested), then a drug is applied and the same trials are run to give a ...
1
vote
0answers
19 views

Analysis of possibly correlated small sample data

I'm doing an experiment where I'm imaging 3 groups of 5 rabbits (total = 15 rabbits) using 4 different machines at 4 different anatomical locations to see if a radio-opaque material is visible in all ...
1
vote
0answers
254 views

Fisher's & McNemar's tests

I'm conducting a retrospective study to assess the efficacy of a new test for predicting sudden cardiac death (SCD). I also want to compare the accuracy of my new predictor with that of a conventional ...
1
vote
0answers
75 views

Test for measuring change when you have same primary sampling units but different respondents in two waves of longitudinal survey

Which test should I apply for measuring change in proportions and means when I have same primary sampling units but different respondents in two waves of longitudinal survey? Should I apply McNemar's ...
0
votes
0answers
11 views

Is it reasonable to do a test of marginal homogenity (mcnemar-bowker) when some combinations of the cells cannot possibly occur?

I have some patients that have none, mild and moderate form of a disease monitored at baseline and at 6-months. I would like to do the mcNemar-bowker test to see whether the drug given to everyone has ...
0
votes
0answers
51 views

NcNemar's test for 1:2 matched data

Does anyone use McNemar's test for fractional values after 1-to-2 propensity score matching? How correct would it be? For instance, let me have 0-1 outcomes and the following matched observations (...
0
votes
0answers
7 views

When comparing classificators, is McNemar's test applied to the output or to the hits?

Suppose I have the following output, alongside the ground-truth ($GT$), for two classifiers $C_1$ and $C_2$: ...
0
votes
1answer
26 views

Single Group Pre-Post McNemar Table Set Up

I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention. Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
0
votes
0answers
64 views

McNemar or Cochran's Q for evaluating multiclass classifiers?

full disclosure: I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other. tl;dr For ...
0
votes
0answers
107 views

Difference in insight gained from Cohens' Kappa vs McNemar

I would like to understand the difference in what a test with Cohen's Kappa tells you about your data compared to what McNemar's test tells you. If Cohen's Kappa measures agreement between two ...
0
votes
1answer
35 views

Conditional Exact Logistic Regression

I have paired data for two tests. I would like to say that Test A is more sensitive than Best B, but not sure if I'm using the correct methods or if my data support it. I know McNemar's Exact test can ...
0
votes
0answers
41 views

comparing sensitivities

We want to compare two sampling methods. All patients will go through a DNA test for diagnosis(positive or negative). Then samples are taken to identify the determine the type of bacteria and ...
0
votes
0answers
47 views

One-tailed test for comparing paired dichotomous responses

Given reference samples $R_i$, I have two dichotomous responses $X_i$ and $Y_i$ I wish to compare. Each dichotomous response (relevant vs. irrelevant to the reference $R_i$) is generated by an ...
0
votes
0answers
26 views

Which test to use when comparing diagnostic performance of doctors with and without a computer assisted diagnostic support tool?

This will seem very basic so my apologies. Lets say I have 10 doctors who are inexperienced diagnosing cancer in 100 patients. 50 patients have cancer and the other 50 do not. The doctors provide a ...
0
votes
1answer
74 views

What would be appropriate test to compare two lists of dichotomous variables?

Colleagues, can't wrap my mind on simple question, please help! I have two products and list of their attributes. My respondents make an answer which product on each attribute they prefer. Finally ...
0
votes
1answer
110 views

What test to use to compare two distributions (from the same group of people)?

I have a data that consists of some "after treatment" and "before treatment" observations from some individuals. Specifically the data looks like this: ...
0
votes
0answers
187 views

Two tails or one tail McNemar's test in a binary classification problem. Which one should i choose?

I'm using McNemar's test for compare two designed models in a binary classification problem. As you know we have two kinds of this test. ...
0
votes
0answers
215 views

McNemar - is it the right test for this example? Effect size?

I have two dependent groups that could have a disease before and after a treatment. My sample size is 12214 subjects. Before the treatment, 7 of them had the disease and after the treatment 14 of them ...
0
votes
0answers
295 views

Need McNemar test for non-dichtomous variables (5x7)

I am looking to analyze nonparametric, related sample data using a test similar to the McNemar. My independent and dependent variables are not dichotomous (7x5). For example, if my IV was level of ...
0
votes
1answer
166 views

McNemar or z-test?

I'm doing a matched sample evaluation to see if there is a statistical difference in graduation rates at a college for total sample and sub-groups within the sample after a policy change intended to ...