Questions tagged [mcnemar-test]
A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.
154
questions
0
votes
0
answers
28
views
How to interpret high P-value and low Mcnemar's Test P-value in Caret R?
I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
- 101
2
votes
1
answer
21
views
Statistical test for PCR and bacterial culture with two different testing methods
I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
- 21
2
votes
0
answers
40
views
Confused about interpretation and intuition behind Mcnemar's Test [duplicate]
I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
- 21
0
votes
0
answers
58
views
Choosing statistical test for Preference-shift
I am having trouble choosing the proper method to support my hypothesis.
I have conducted an animal study, where subjects chose A or B, 6 times a day for 3 days (day 1~3).
At first, I divided the ...
- 95
2
votes
0
answers
98
views
How to test if watching a advertisement only 1 time is enough to change one's preference
I'm sort of having a trouble finding what statistical test to use in a specific project of mine.
My experiment was as follows:
I have 10 friends and they all prefer Coke cola then Pepsi.
Each of them ...
- 95
0
votes
0
answers
10
views
Which test for a withinparticipant design with 2 categorical variables (with each participant having a value in each condition)
Design : two categorical variables. First : the independent variable : "type" with two conditions : intra & inter. Next, the measured variable : "consistance" with two ...
- 1
0
votes
0
answers
15
views
deciphering between statistical tests
I want would like to test if the mean iron
concentrations were higher at delivery time in the vaxx
group compared to the placebo ,what hypothesis test would i use
user352099
0
votes
0
answers
59
views
What kind of significance tests can I apply on before/after data that involves proportions?
I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages.
There are two columns which show the ...
- 111
1
vote
2
answers
158
views
test of significance for two groups of classification results
I will edit this question for more specific questions.
I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
0
votes
1
answer
31
views
Test for pre-post test binary data for 3 groups
I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
- 1
0
votes
0
answers
11
views
Hypothesis test for the effectiveness of a binary classification tool
I am testing a tool for binary classification and am unsure what kind of null-hypothesis (and associated test) I should use to assess its effectiveness. In simplified terms, I have a data set of ...
- 1
2
votes
2
answers
99
views
Replacing McNemar test with regression?
Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)?
Let's have a made-up example ...
- 83
1
vote
0
answers
35
views
Alternatives to Chi-square test when observations are dependent
I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
- 65
0
votes
1
answer
21
views
Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)
For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
- 119
0
votes
0
answers
48
views
Conflicting McNemar chi square vs McNemar-Bowker interpretations
I am having a hard time understanding results between two tests that theoretically should be testing the same thing but seem to say something different. My study is of 180 subjects/farms that were ...
- 23
0
votes
1
answer
30
views
McNemar exact DP test not running in R [closed]
I am unable to run the provided example (copy/pasted from here):
...
- 674
1
vote
1
answer
153
views
In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?
In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results:
...
- 674
0
votes
0
answers
47
views
Two categorical variables with many levels, dependent samples
I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
- 11
0
votes
0
answers
32
views
Confusion matrix test-retest reliability (McNemar or paired t-test)
I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1
vote
0
answers
31
views
Which Statistical Hypothesis Test is appropriate Here?
I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis.
The data was ...
- 11
0
votes
0
answers
30
views
Mcnemar's Test P-Value is equal to 1.00000
Good afternoon ,
I had trained a som classifier then i applied the classifier in a dataset of few rows ( ballons dataset from UCI repository ).
...
- 113
1
vote
2
answers
601
views
McNemar-Bowker exact test in R: difficulty interpreting the results
I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
- 23
1
vote
0
answers
141
views
Comparing two multi-class machine learning classifiers using Stuart Maxwell Test
I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps:
obtain prediction on test data using ...
- 23
2
votes
1
answer
126
views
McNemar's for 1:N Matched Pairs (for N>1)
Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible.
Each case is ...
0
votes
1
answer
209
views
Stratification McNemar Test in R
I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc).
What I need to know if ...
- 41
0
votes
0
answers
12
views
How to select dichotomous variables?
I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
- 2,680
1
vote
0
answers
207
views
When is "Cochran–Mantel–Haenszel" like "McNemar's test"?
In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
- 20k
0
votes
1
answer
300
views
Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)
Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
- 20k
1
vote
2
answers
67
views
Looking for an interaction between dichotomous variables with paired data using glmer in R
Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
1
vote
0
answers
19
views
is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?
the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
1
vote
1
answer
128
views
Interpretation of McNemar test example
In this tutorial
https://learningstatisticswithr.com/book/chisquare.html
in Example 12.8.1 I understand the result of the test
...
- 61
2
votes
0
answers
30
views
Analyze Repeated Measures of a Frequency
I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
1
vote
0
answers
182
views
How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test
I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
- 224
1
vote
1
answer
118
views
Why McNemar is usually significant even in case of zero events on both sides?
After propensity score matching, we can assess balance between matched cohorts using McNemar test.
I wonder why it is usually significant even in case of zero events on both sides.
I saw prior ...
- 151
3
votes
1
answer
88
views
If we use McNemar's for single case data, is pseudoreplication an issue?
I have a query about McNemar's test. As far as I understand, the technique assumes that cells are independent. It tends to be used with group studies whereby counts refer to individuals, for example a ...
- 521
1
vote
0
answers
15
views
Comparing responses between groups and conditions
I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
- 11
0
votes
0
answers
64
views
Can I test the difference between two chi square statistics for significance
I'm working on a (currently) hypothetical problem that relates to monitoring and evaluating people's participation in recycling. The test statistic is the participation rate (the proportion of ...
- 11
0
votes
1
answer
146
views
Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?
Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
- 11
1
vote
0
answers
18
views
Chi2 versus other tests for dependent samples (same observer different time)
I have come across a problem at deciding which hypothesis test I should use.
I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
3
votes
1
answer
100
views
Is McNemar's Test Appropriate Here?
I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
user275017
0
votes
0
answers
41
views
What Statistical Analysis test do I run for Pre/post test?
Hello I am conducting a study where I examine patients who have not received a flu vaccination. In all I have 45 participants all who have not received the vaccine. I implemented and educational ...
- 1
1
vote
1
answer
27
views
How to Test Sampling Methods
Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
- 111
2
votes
1
answer
267
views
Chi Square test or McNemar test?
I've got a set of 1000 patients and I am measuring two different blood values (CRP and IL6) and choosing a categorical cutoff values for both (CRP>10 and IL6 >2). I now would like to know if there is ...
- 23
0
votes
0
answers
44
views
The McNemar exact conditional test: should the p-values be uniform under the null?
I have two classification models, $C_1$ and $C_2$, and I want to do a hypothesis test to see if $C_1$ is significantly better than $C_2$. I am interested in a one-sided hypothesis test. Thus I have ...
- 1,012
2
votes
1
answer
79
views
Another solution than McNemar test for bilateral asymmetry on binary data?
Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side.
I need to test the ...
- 21
1
vote
1
answer
49
views
Statistical test for difference-hypothesis with dichotomous dependent and independent variables
I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
- 25
1
vote
2
answers
104
views
What statistical test would I use to test that both data sources are matching [closed]
Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...
0
votes
1
answer
75
views
Single Group Pre-Post McNemar Table Set Up
I am looking to evaluate if the change in proportion for a group changed pre-to-post intervention.
Essentially, is the ~7% increase from pre (~2%) to post (~9%) significant. I am running the McNemar ...
0
votes
1
answer
46
views
Chi-square based tests tending to zero for large sample sizes [duplicate]
I think I have some misconception about chi-square based tests such as Pearson's test or McNemar's test. The way the tests are defined, the test statistics produced by the formulas are not stable ...
- 199
0
votes
0
answers
855
views
McNemar or Cochran's Q for evaluating multiclass classifiers?
full disclosure:
I did a semi-cross post of this question due to low traffic. Once I get an answer on any of the two questions, I will link the answer back to the respective other.
tl;dr
For ...
- 199