Questions tagged [mcnemar-test]
A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.
144
questions
0
votes
0answers
36 views
Conflicting McNemar chi square vs McNemar-Bowker interpretations
I am having a hard time understanding results between two tests that theoretically should be testing the same thing but seem to say something different. My study is of 180 subjects/farms that were ...
0
votes
1answer
20 views
McNemar exact DP test not running in R [closed]
I am unable to run the provided example (copy/pasted from here):
...
1
vote
1answer
81 views
In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?
In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results:
...
1
vote
0answers
40 views
Two categorical variables with many levels, dependent samples
I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
0
votes
0answers
21 views
Confusion matrix test-retest reliability (McNemar or paired t-test)
I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1
vote
0answers
28 views
Which Statistical Hypothesis Test is appropriate Here?
I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis.
The data was ...
0
votes
0answers
16 views
Mcnemar's Test P-Value is equal to 1.00000
Good afternoon ,
I had trained a som classifier then i applied the classifier in a dataset of few rows ( ballons dataset from UCI repository ).
...
1
vote
2answers
255 views
McNemar-Bowker exact test in R: difficulty interpreting the results
I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
1
vote
0answers
69 views
Comparing two multi-class machine learning classifiers using Stuart Maxwell Test
I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps:
obtain prediction on test data using ...
0
votes
0answers
54 views
McNemar significance test for 5-fold cross validation
I have used stratified 5-fold cross validation to generate five data folds to compare several (N) deep learning models on a single dateset. It is not possible to change the cross validation to 5x2 as ...
2
votes
1answer
60 views
McNemar's for 1:N Matched Pairs (for N>1)
Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible.
Each case is ...
0
votes
1answer
131 views
Stratification McNemar Test in R
I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc).
What I need to know if ...
0
votes
0answers
11 views
How to select dichotomous variables?
I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
0
votes
0answers
27 views
Clustered pre-post analysis dichotomous variables in SPSS
I’m not entirely sure how to analyze data we have from the following study:
We trained three teams of health care professionals of three different palliative care wards
We would like to analyze the ...
1
vote
0answers
106 views
When is "Cochran–Mantel–Haenszel" like "McNemar's test"?
In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
0
votes
1answer
151 views
diff-in-diff for binary outcome? (i.e.: Comparing proportions of two groups over two time points in paired setting)
Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
1
vote
2answers
58 views
Looking for an interaction between dichotomous variables with paired data using glmer in R
Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
1
vote
0answers
14 views
is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?
the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
1
vote
1answer
84 views
Interpretation of McNemar test example
In this tutorial
https://learningstatisticswithr.com/book/chisquare.html
in Example 12.8.1 I understand the result of the test
...
0
votes
0answers
54 views
Using McNemar's test in a Nested Cross Validation
I have developed a nested cross-validation (11x10) routine to compare two alternative deep learning architectures.
By running the algorithm, I saved the accuracy values obtained by the two models on ...
0
votes
0answers
32 views
Application and confidence interval of McNemar test in comparing methods?
Given a known cohort (say all male) of 1510 people, if method A and method B are applied to predict M/...
2
votes
0answers
24 views
Analyze Repeated Measures of a Frequency
I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
1
vote
0answers
119 views
How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test
I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
1
vote
1answer
79 views
Why McNemar is usually significant even in case of zero events on both sides?
After propensity score matching, we can assess balance between matched cohorts using McNemar test.
I wonder why it is usually significant even in case of zero events on both sides.
I saw prior ...
3
votes
1answer
71 views
If we use McNemar's for single case data, is pseudoreplication an issue?
I have a query about McNemar's test. As far as I understand, the technique assumes that cells are independent. It tends to be used with group studies whereby counts refer to individuals, for example a ...
1
vote
0answers
14 views
Comparing responses between groups and conditions
I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
0
votes
0answers
55 views
Can I test the difference between two chi square statistics for significance
I'm working on a (currently) hypothetical problem that relates to monitoring and evaluating people's participation in recycling. The test statistic is the participation rate (the proportion of ...
0
votes
1answer
112 views
Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?
Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
1
vote
0answers
17 views
Chi2 versus other tests for dependent samples (same observer different time)
I have come across a problem at deciding which hypothesis test I should use.
I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
3
votes
1answer
80 views
Is McNemar's Test Appropriate Here?
I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
0
votes
0answers
36 views
What Statistical Analysis test do I run for Pre/post test?
Hello I am conducting a study where I examine patients who have not received a flu vaccination. In all I have 45 participants all who have not received the vaccine. I implemented and educational ...
1
vote
1answer
27 views
How to Test Sampling Methods
Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
2
votes
1answer
196 views
Chi Square test or McNemar test?
I've got a set of 1000 patients and I am measuring two different blood values (CRP and IL6) and choosing a categorical cutoff values for both (CRP>10 and IL6 >2). I now would like to know if there is ...
0
votes
0answers
35 views
The McNemar exact conditional test: should the p-values be uniform under the null?
I have two classification models, $C_1$ and $C_2$, and I want to do a hypothesis test to see if $C_1$ is significantly better than $C_2$. I am interested in a one-sided hypothesis test. Thus I have ...
0
votes
0answers
66 views
Another solution than McNemar test for bilateral asymmetry on binary data?
Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side.
I need to test the ...
1
vote
1answer
41 views
Statistical test for difference-hypothesis with dichotomous dependent and independent variables
I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
1
vote
2answers
97 views
What statistical test would I use to test that both data sources are matching [closed]
Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...
0
votes
1answer
58 views
Single Group Pre-Post McNemar Table Set Up
I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention.
Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
0
votes
1answer
41 views
Chi-square based tests tending to zero for large sample sizes [duplicate]
I think I have some misconception about chi-square based tests such as Pearson's test or McNemar's test. The way the tests are defined, the test statistics produced by the formulas are not stable ...
0
votes
0answers
724 views
McNemar or Cochran's Q for evaluating multiclass classifiers?
full disclosure:
I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other.
tl;dr
For ...
4
votes
1answer
88 views
Can I perform a McNemar's test with only proportion and denominator information?
I have the following count and denominator information. The 630 subjects are the same people over two different periods of time. Can I conduct a McNemar's test to compare the dependent proportion ...
0
votes
1answer
106 views
Conditional Exact Logistic Regression
I have paired data for two tests. I would like to say that Test A is more sensitive than Best B, but not sure if I'm using the correct methods or if my data support it. I know McNemar's Exact test can ...
1
vote
0answers
36 views
Hypothesis testing with two dependent multilevel categorical variables [closed]
I was presented with a requirement of comparing two sources of diagnoses on the same subjects, resulting in two 4-level categorical variables. I offered to calculate Cohen's Kappa, but the interested ...
1
vote
1answer
136 views
Multiple Observations per Subject per Time-point analysis?
I am having a difficult time finding an appropriate test for my analysis. Please help -
In my study I have 130 participants who were tested with a binary outcome (pass [1] /fail [0]) before and ...
1
vote
1answer
272 views
Comparison of proportions using McNemar's Chi-Square using Pre- and Post- data for two disease conditions
This question follows-up on the post: What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each?
I am examining a pre- and post- intervention data ...
0
votes
0answers
73 views
comparing sensitivities
We want to compare two sampling methods. All patients will go through a DNA test for diagnosis(positive or negative). Then samples are taken to identify the determine the type of bacteria and ...
0
votes
1answer
235 views
Comparing proportions from overlapping samples
I'm looking to compare the read rate of an email newsletter with the read rate of another newsletter. However, many (not all) of the people who receive one newsletter also receive the other. What ...
1
vote
0answers
829 views
How do I get an odds ratio with McNemar's test?
I have pre and post test data evaluating the effectiveness of a lesson about how to help friends who are being bullied. I am trying to see if more students know how to help a friend being bullied ...
2
votes
3answers
467 views
Hypothesis test for intervention with class imbalance before intervention. Alternative to McNemar
I want to assess an intervention to cure a disease. An example is described by the following matrix:
...
0
votes
2answers
222 views
How to Control Familywise Error Rate in a series of Planned McNemar Comparisons
I have paired binary responses from same subjects under 9 different conditions. I conducted Cochran's Q which indicated that there significantly different pairs exist. I want to follow up but NOT ...
