Questions tagged [mcnemar-test]
A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.
179
questions
0
votes
1
answer
20
views
Comparison Sensitivity and Specificity - hold one stable for comparison of the other?
Given two binary diagnostic tests, T1 and T2, I want to compare the Sensitivity and Specificity of the two tests when given to a sample of subjects. Each subject will receive both tests, and there is ...
- 1,160
1
vote
1
answer
50
views
Comparing outcomes from 2 diagnostic criteria (McNemar Exact Test?)
First time poster here.
I am stuck trying to figure out the correct statistical test for my research question.
I am comparing two possible outcomes using the results from the same dataset. These ...
- 11
1
vote
0
answers
26
views
What type of test should I use for paired categorical data?
Somewhat similar questions have been asked here and here, but none of the other answers are really applicable in my case.
I have a group of people, where in Year 1 everybody is sick. Here I have only ...
- 11
0
votes
0
answers
27
views
Is there an way to model random effects in a design that is typically analyzed by the McNemar test?
My question is: if in a study with paired binary response data (where McNemar test is often used) we can use the exact binomial test to test the odds ratio, is it possible to model the same odds ratio ...
- 569
0
votes
0
answers
18
views
How to test whether the "prevalence ratio" of one marker is higher than that of another
Here is my setup. I have two sets of DNA sequences, one bound by a protein (transcription factor), another not bound by the protein. Let's say I have two candidate motifs, or DNA patterns the protein ...
0
votes
0
answers
9
views
inference proportional change (dependent proportions) from before to after
I'm not sure whether the McNemar test is an appropriate choice in the situation below. I'd like to see whether an intervention had an effect on screening adherence, which can be done only once your ...
- 1
3
votes
1
answer
51
views
Comparing classifications based on different features with McNemar test
I have a classification task where I need to classify several land cover classes (such as forest, grass, water, etc.) based on two different sets of features (predictors). The first set of features ...
- 183
1
vote
0
answers
32
views
What test for comparing results before and after an intervention?
I'm writing a paper in which we show a doctor some lab results for a group of patients and ask him to say yes or no to a diagnosis blindly. Then, I tell him the patient's history and other important ...
2
votes
1
answer
106
views
Chi square test (or alternative) for mixed design categorical data
I have the following question:
I collected the number of different symptoms at two time points (Baseline BL, Follow-up FU) in two groups (Control Group CG, Intervention Group IG). So, there is a ...
- 159
0
votes
0
answers
30
views
Choosing an appropriate statistical test in Multi-Reader Multi-Case (MRMC) Scenario
I am looking for the most suitable statistical test for the following situation:
I am in a multi-reader multi-case (MRMC) scenario where 6 readers will perform binary classification on the same 165 ...
- 1
0
votes
1
answer
126
views
Required sample size for exact McNemar test and for phi coefficient (power analysis)
I aim to establish the required sample size for my study. In the main analyses, which are conducted to test my hypotheses, I am investigating two 2x2 tables. Specifically, I plan to perform an exact ...
- 1
0
votes
0
answers
33
views
McNemar test or similar with multiple pairings?
Let's say I have test condition A and B, and a binary classification model. I have paired samples in conditions A and B, and I want to test if these conditions are different in classifier performance. ...
- 1
0
votes
0
answers
27
views
How can I apply McNemar’s test in matched case control study on SPSS?
When conducting a case-control study with 120 cases 1:1 to 120 controls and examining whether they had a binary exposure prior to developing the disease. I am using conditional logistic regression for ...
1
vote
0
answers
31
views
McNemar variant with multiple measurements per subject
I have a scenario where 3 subjects evaluate 12 cases of a problem with two pieces of equipment. Each subject evaluates each case with equipment A, then equipment B. The outcome variable is binary, 0 (...
- 11
0
votes
0
answers
10
views
Validating a new definition for detection
I am having some trouble understanding what approach I would use to validate a new set of definitions versus the "gold standard" to detect disease positivity. For example, if I wanted to say ...
- 75
1
vote
1
answer
135
views
How do I do McNemar test for propensity matched data in R?
I did propensity score matching for retrospective data, and now I want to run outcome analysis. For dichotomous variables, I heard that I need to do McNemar test since I should treat propensity score ...
- 11
1
vote
0
answers
117
views
Using McNemar-Bowker test to see if two metrics are measuring the same characteristic
I have a dataset of photos of dogs with both black and white fur. One person assessed the images by two criteria:
Criteria 1: how much white fur does the dog have:
More than 0% and less than 25%
More ...
- 11
1
vote
0
answers
191
views
McNemar's test with multiple comparisons
I would like to test the difference between two classification outcomes for statistical significance using McNemar's test, but I am unsure how to best account for multiple comparisons.
The setting is ...
0
votes
0
answers
92
views
Chi-square test, McNemar test, or something else for comparing proportions of overlapping groups
Goal: I am trying to compare the proportion of participants who choose one of the combined options (A-B and B-A) in questions where they see A-First vs questions where they see B-First.
Data: I have ...
- 165
1
vote
0
answers
68
views
I'm having trouble choosing between Wilcoxon matched pairs test and McNemar test for a data set
I have a data set on a large group of long-term stroke survivors. I need to determine whether there is a difference in ability (on a scale of 1-10) between their left and right arms. The ordinal data ...
1
vote
1
answer
57
views
How to derive sampling variance of paired differences？
I'm reading the paper (Mcnemar 1947), which introduces the origin of Mcnemar's test. And it gets me confused by understanding the equation of sampling variance of difference between proportional ...
- 27
1
vote
0
answers
26
views
Self-perceived competence vs objectively measured competence: $\chi^2$ test of independence or McNemar's test?
My research question is to determine whether self-perceived competence is an indicator of objectively measured competence in a group of physiotherapy students?
I have measured self-perceived ...
1
vote
1
answer
359
views
Comparing diagnostic test in different populations
I have 5 diagnostic tests (test A, B, C and D) for a certain disease, tested in 2 different populations.
For comparing test parameters (sensitivity, specificity) of test A and B in the same population ...
1
vote
0
answers
118
views
How to implement a Two-Sample McNemar Test in R [closed]
I'm trying to perform a Two-sample McNemar's test on my data, but I was not able two find any R package implementing the method. I'm familiar with the simple McNemar's test function mcnemar.test(), ...
- 23
1
vote
1
answer
76
views
All participants performed 12 binomial trials for the manipulation and control conditions. What is the best statistical test to compare conditions?
All 80 participants performed 12 binomial trials (0-failed, 1-success) for the manipulation condition and 12 binomial trials for the control condition.
My database is something like this, but with ...
- 365
0
votes
0
answers
147
views
test for difference between matched pairs in 1:1 matched study
Background: I have a retrospective study (registry) that contains data on people with kidney transplant. Among these patients, we have a very small number of people with a specific genetic disease (n=...
- 173
1
vote
1
answer
330
views
Chi-squared for repeated measures for 2 by n
I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
- 329
1
vote
1
answer
519
views
McNemar test or Two proportion z-test?
Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is:
Is there a difference between ...
- 13
1
vote
0
answers
42
views
What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?
I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
- 21
1
vote
0
answers
238
views
How to interpret high P-value and low Mcnemar's Test P-value in Caret R?
I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
- 389
2
votes
1
answer
40
views
Statistical test for PCR and bacterial culture with two different testing methods
I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
- 21
2
votes
0
answers
43
views
Confused about interpretation and intuition behind Mcnemar's Test [duplicate]
I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
- 21
2
votes
0
answers
104
views
How to test if watching a advertisement only 1 time is enough to change one's preference
I'm sort of having a trouble finding what statistical test to use in a specific project of mine.
My experiment was as follows:
I have 10 friends and they all prefer Coke cola then Pepsi.
Each of them ...
- 95
0
votes
0
answers
17
views
deciphering between statistical tests
I want would like to test if the mean iron
concentrations were higher at delivery time in the vaxx
group compared to the placebo ,what hypothesis test would i use
user352099
0
votes
0
answers
69
views
What kind of significance tests can I apply on before/after data that involves proportions?
I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages.
There are two columns which show the ...
- 121
2
votes
2
answers
495
views
test of significance for two groups of classification results
I will edit this question for more specific questions.
I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
- 101
0
votes
1
answer
166
views
Test for pre-post test binary data for 3 groups
I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
- 1
3
votes
2
answers
579
views
Replacing McNemar test with regression?
Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)?
Let's have a made-up example ...
- 93
3
votes
0
answers
349
views
Alternatives to Chi-square test when observations are dependent
I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
- 85
1
vote
1
answer
500
views
Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)
For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
- 139
0
votes
1
answer
299
views
McNemar exact DP test not running in R [closed]
I am unable to run the provided example (copy/pasted from here):
...
- 706
1
vote
1
answer
427
views
In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?
In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results:
...
- 706
0
votes
0
answers
112
views
Two categorical variables with many levels, dependent samples
I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
- 61
0
votes
0
answers
107
views
Confusion matrix test-retest reliability (McNemar or paired t-test)
I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1
vote
0
answers
39
views
Which Statistical Hypothesis Test is appropriate Here?
I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis.
The data was ...
- 11
1
vote
2
answers
2k
views
McNemar-Bowker exact test in R: difficulty interpreting the results
I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
- 23
1
vote
0
answers
384
views
Comparing two multi-class machine learning classifiers using Stuart Maxwell Test
I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps:
obtain prediction on test data using ...
- 23
2
votes
1
answer
502
views
McNemar's for 1:N Matched Pairs (for N>1)
Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible.
Each case is ...
0
votes
1
answer
599
views
Stratification McNemar Test in R
I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc).
What I need to know if ...
- 41
0
votes
0
answers
32
views
How to select dichotomous variables?
I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
- 2,930