Questions tagged [mcnemar-test]
A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.
156
questions
0
votes
1
answer
39
views
Chi-squared for repeated measures for 2 by n
I have data on patients who have two gastric samples drawn to culture bacteria. I would like to see if gastric pH (categorized as acidic, neutral, or basic) has an influence on the dichotomous outcome ...
- 179
0
votes
0
answers
25
views
Infinite odds ratio
I tested 100 samples using two tests (each sample receIved to tests in parallel). I want to see if there is a significant difference between the occurance of invalid tests from the two tests. My ...
- 1
1
vote
1
answer
61
views
McNemar test or Two proportion z-test?
Consider an experiment where a group of 200 people were asked before and after what is their preference, with possible outcomes being A and B. The research question is:
Is there a difference between ...
- 13
1
vote
0
answers
34
views
What is an alternative to Chi-Square for observed vs. expected variance suitable for repeated measures?
I want to test for individual-level side preference of a behaviour during an experiment, and found a way to do this using a chi-square test that uses the number of right (or left) turns out of the ten ...
- 21
0
votes
0
answers
61
views
How to interpret high P-value and low Mcnemar's Test P-value in Caret R?
I am using the caret R package to evaluate machine learning models. This gives me a lot of information about different metrics. I am confused about my result why ...
- 121
2
votes
1
answer
30
views
Statistical test for PCR and bacterial culture with two different testing methods
I have previously used McNemar's test to compare PCR and bacterial culture using the same sample. I now have two different samples from the same patient taken from tonsills and quincy. So I now have 4 ...
- 21
2
votes
0
answers
41
views
Confused about interpretation and intuition behind Mcnemar's Test [duplicate]
I've always been under the impression that Mcnemar's Test is for paired categorical data, just like paired t-tests are for paired continuous data. However, I was looking at the Wikipedia article for ...
- 21
0
votes
0
answers
79
views
Choosing statistical test for Preference-shift
I am having trouble choosing the proper method to support my hypothesis.
I have conducted an animal study, where subjects chose A or B, 6 times a day for 3 days (day 1~3).
At first, I divided the ...
- 95
2
votes
0
answers
103
views
How to test if watching a advertisement only 1 time is enough to change one's preference
I'm sort of having a trouble finding what statistical test to use in a specific project of mine.
My experiment was as follows:
I have 10 friends and they all prefer Coke cola then Pepsi.
Each of them ...
- 95
0
votes
0
answers
15
views
Which test for a withinparticipant design with 2 categorical variables (with each participant having a value in each condition)
Design : two categorical variables. First : the independent variable : "type" with two conditions : intra & inter. Next, the measured variable : "consistance" with two ...
- 1
0
votes
0
answers
17
views
deciphering between statistical tests
I want would like to test if the mean iron
concentrations were higher at delivery time in the vaxx
group compared to the placebo ,what hypothesis test would i use
user352099
0
votes
0
answers
62
views
What kind of significance tests can I apply on before/after data that involves proportions?
I am trying to determine whether there is statistical significance from two groups of data. I have the data in terms of counts and proportions or percentages.
There are two columns which show the ...
- 111
1
vote
2
answers
199
views
test of significance for two groups of classification results
I will edit this question for more specific questions.
I want to predict the presence of multiple, binary questionnaire items with a classifier, such as SVM. I do this via 10 fold nested cross ...
0
votes
1
answer
62
views
Test for pre-post test binary data for 3 groups
I want to confirm what test to use for my data. I have three intervention groups. With the presence of a certain pathogen 1/0 (yes/no) before and after treatment. I want to analyze if there is a ...
- 1
0
votes
0
answers
16
views
Hypothesis test for the effectiveness of a binary classification tool
I am testing a tool for binary classification and am unsure what kind of null-hypothesis (and associated test) I should use to assess its effectiveness. In simplified terms, I have a data set of ...
- 1
3
votes
2
answers
169
views
Replacing McNemar test with regression?
Would it be possible to replace the McNemar test with regression? What would be the regression formula? What type of regression should be used (logistic?, some survival?)?
Let's have a made-up example ...
- 93
1
vote
0
answers
70
views
Alternatives to Chi-square test when observations are dependent
I have cross-tabulated some data from a survey. The core survey questions have been cross-tabulated with demographic variables. I am looking at these cross-tabulations to see if any interesting trends ...
- 65
0
votes
1
answer
48
views
Not sure what test to run to compare the proportions of a count outcome across a variable with 5 levels, between two groups (using R for analyses)
For a case-control study that I've conducted I've measured how many times a count outcome (count_outcome) occurred in each of 4 areas (...
- 119
0
votes
1
answer
67
views
McNemar exact DP test not running in R [closed]
I am unable to run the provided example (copy/pasted from here):
...
- 694
1
vote
1
answer
204
views
In R, how is a "conditional MLE" calculated for the odds ratio of an exact McNemar test?
In R, if I use the function mcnemar.exact from the exact2x2 package for my data set I get the following results:
...
- 694
0
votes
0
answers
58
views
Two categorical variables with many levels, dependent samples
I have data from many participants, who each answered the same question about each of several stimuli, assigning each stimulus to a category (with replacement). This would be an example of said data ...
- 61
0
votes
0
answers
51
views
Confusion matrix test-retest reliability (McNemar or paired t-test)
I would like to ensure test retest reliability between test runs. Each run produces a 2x2 confusion matrix reporting the number of true positives, false positives, false negatives, and true negatives. ...
1
vote
0
answers
31
views
Which Statistical Hypothesis Test is appropriate Here?
I have two contingency tables (screenshots below) - This is the results of age range 19-30, I also have two tables for above 30s. I am requesting help with rejecting a null hypothesis.
The data was ...
- 11
1
vote
2
answers
902
views
McNemar-Bowker exact test in R: difficulty interpreting the results
I am trying to use the McNemar-Bowker test to test the difference in performance for 2 classifiers. Since my input matrix is sparse and the sum of some of the symmetric cells is less than 10, I am ...
- 23
1
vote
0
answers
182
views
Comparing two multi-class machine learning classifiers using Stuart Maxwell Test
I need to compare 2 multi-class classifiers. So, to assess whether the difference between the two are statistically significant I have taken the following steps:
obtain prediction on test data using ...
- 23
2
votes
1
answer
178
views
McNemar's for 1:N Matched Pairs (for N>1)
Sorry for the ignorant question, but I have 1:4 matched pairs data. I am trying to understand how one would run a McNemar's test in this situation, or if it would even be possible.
Each case is ...
0
votes
1
answer
276
views
Stratification McNemar Test in R
I have categorical data before and after a condition (paired data) about preferences (yes/no) and I have other variables such as sociodemographic values (sex, ethnicity, etc).
What I need to know if ...
- 41
0
votes
0
answers
13
views
How to select dichotomous variables?
I have a data set of 57 dichotomous items that constitute a scale for measuring a particular condition. I also have another dichotomous variable of the condition itself. I would like to do some factor ...
- 2,690
1
vote
0
answers
260
views
When is "Cochran–Mantel–Haenszel" like "McNemar's test"?
In Wikipedia, the article on Cochran–Mantel–Haenszel statistics states that "The McNemar test can only handle pairs. The CMH test is a generalization of the McNemar test as their test statistics ...
- 20.4k
1
vote
1
answer
458
views
Diff-in-Diff with a binary outcome? (i.e., comparing proportions of two groups over two time points in a paired setting)
Let's say I have students randomly split into two groups (treatment and control). Each student is given a test and they either pass or fail. They then either take a course (the students in "...
- 20.4k
1
vote
2
answers
73
views
Looking for an interaction between dichotomous variables with paired data using glmer in R
Imagine someone sampled some chimpanzees, each chimpanzee was given two puzzle boxes to open to obtain a food reward (boxes A and B), for each case the person recorded success or failure to get the ...
1
vote
0
answers
20
views
is mcnemar's test suitable to evaluate the differences of the proportions of events between the subgroups of risk scores?
the authors indicated that comparing event frequencies of events between subgroups( example frs and df) of groups ( low intermediate high) mcnemar's test was used. is it right for this study design?
1
vote
1
answer
169
views
Interpretation of McNemar test example
In this tutorial
https://learningstatisticswithr.com/book/chisquare.html
in Example 12.8.1 I understand the result of the test
...
- 61
2
votes
0
answers
40
views
Analyze Repeated Measures of a Frequency
I have the same group of participants (n=31,000) that answered the following question "What is your favorite subject?" by selecting one of three answer options (Science, Math, Art) at two ...
1
vote
0
answers
236
views
How to compare and get confidence intervals for paired proportions (correct detection rates) using McNemar's test
I want to compare the diagnostic efficiencies of two methods using overall correct classification rates (i.e., (sensitivity+specificity)/2, and assuming approx. ...
- 184
2
votes
1
answer
161
views
Why McNemar is usually significant even in case of zero events on both sides?
After propensity score matching, we can assess balance between matched cohorts using McNemar test.
I wonder why it is usually significant even in case of zero events on both sides.
I saw prior ...
- 201
3
votes
1
answer
100
views
If we use McNemar's for single case data, is pseudoreplication an issue?
I have a query about McNemar's test. As far as I understand, the technique assumes that cells are independent. It tends to be used with group studies whereby counts refer to individuals, for example a ...
- 531
1
vote
0
answers
15
views
Comparing responses between groups and conditions
I have a group of subjects that were tested under 2 visual stimuli. Each stimuli was presented in 2 directions (the stimulus is a flow of objects, once left to right and then right to left). And the ...
- 11
0
votes
0
answers
79
views
Can I test the difference between two chi square statistics for significance
I'm working on a (currently) hypothetical problem that relates to monitoring and evaluating people's participation in recycling. The test statistic is the participation rate (the proportion of ...
- 11
0
votes
1
answer
162
views
Why can the null and alternate hypotheses of McNemar's test be written in terms of dependance/independance of tests?
Consider a study to examine whether food frequency questionnaires and three-day food diaries are equally likely to label a women as consuming less than the RDA of calcium. Because calcium intake can ...
- 11
1
vote
0
answers
18
views
Chi2 versus other tests for dependent samples (same observer different time)
I have come across a problem at deciding which hypothesis test I should use.
I have personal previous research (great part of which is lost); of it, I have all the n and the proportions for each ...
3
votes
2
answers
161
views
Is McNemar's Test Appropriate Here?
I am applying two diagnostic tests with dichotomous outcomes (condition present yes/no) to a sample of patient data. Both take into account a range of vital parameters and produce a test result, which ...
user275017
0
votes
0
answers
61
views
What Statistical Analysis test do I run for Pre/post test?
Hello I am conducting a study where I examine patients who have not received a flu vaccination. In all I have 45 participants all who have not received the vaccine. I implemented and educational ...
- 1
1
vote
1
answer
28
views
How to Test Sampling Methods
Suppose I have a population, $P$, of 100 individuals and I am devising 3 algorithmic methods to sample 20 people from said population: $A$, $B$, and $C$. We know that $C$ is a random, unbiased ...
- 111
2
votes
1
answer
316
views
Chi Square test or McNemar test?
I've got a set of 1000 patients and I am measuring two different blood values (CRP and IL6) and choosing a categorical cutoff values for both (CRP>10 and IL6 >2). I now would like to know if there is ...
- 23
0
votes
0
answers
46
views
The McNemar exact conditional test: should the p-values be uniform under the null?
I have two classification models, $C_1$ and $C_2$, and I want to do a hypothesis test to see if $C_1$ is significantly better than $C_2$. I am interested in a one-sided hypothesis test. Thus I have ...
- 1,042
2
votes
1
answer
85
views
Another solution than McNemar test for bilateral asymmetry on binary data?
Let's say I studied the shoulders of 10 individuals, and I scored the presence/absence of a criteria (ex: arthrosis, presence=0;absence=1) on the left side and the right side.
I need to test the ...
- 21
1
vote
1
answer
51
views
Statistical test for difference-hypothesis with dichotomous dependent and independent variables
I need your help. I'm designing a study for the following problem. There is a feature A (implemented by many software from my specific context) and I'm 100% sure that if I ask the users they will ...
- 25
2
votes
1
answer
958
views
Repeated-measure contingency table with two variables with many levels?
I am trying to analyze the results of a survey on what would make people of different ages visit certain tourist places.
However, age was collected as age-group (not my fault). Hence, it is a ...
- 21
1
vote
2
answers
126
views
What statistical test would I use to test that both data sources are matching [closed]
Suppose I am only working with two datasets, Data Source 1 with columns Customer ID and ...
