Questions tagged [mcnemar-test]

A test for dependent categorical data, such as yes/no data before & after a treatment. The McNemar-Bowker test generalizes McNemar's test for $k>2$ categories. The tests assess whether the population proportions in each pair of corresponding symmetric cells are equal.

Filter by
Sorted by
Tagged with
4
votes
1answer
964 views

Proper analyses for 2x2 contingency tables

So I have multiple questions about the different types of analyses that can be used on a 2x2 contingency table and when different analyses should be used. To open, I'll note that this stems from my ...
5
votes
2answers
542 views

Can McNemar's test be improved upon by adjustments for zeros like those in a sign test?

McNemar's test is a special example of the binomial sign test, but the ('vanilla') sign test suffers from bias due to ignoring differences equal to zero. McNemar's test statistic is given by: $\chi^{...
4
votes
2answers
1k views

Is the binomial sign test really the exact McNemar test?

I am calculating two different $p$ values for the McNemar test and what I believe is the corresponding exact test, even for combined counts larger than 25. Take, for example the contingency table <...
0
votes
0answers
237 views

McNemar - is it the right test for this example? Effect size?

I have two dependent groups that could have a disease before and after a treatment. My sample size is 12214 subjects. Before the treatment, 7 of them had the disease and after the treatment 14 of them ...
0
votes
1answer
6k views

Where does p-value come from in McNemar's Test?

I was using this online calculator to work out McNemar's Test on this data set: I get the results: The two-tailed P value equals 0.1859 Chi squared equals 1.750 with 1 degrees of freedom. Now I ...
2
votes
0answers
229 views

Comparison of multiple diagnostic tests with paired data

Good Day All, I am attempting to compare three diagnostic tests against a gold-standard and for simplicity sake, let us have all the outcomes be binary (disease/no disease). In this study study, all ...
2
votes
0answers
259 views

Comparing proportions from the (somewhat) same sample

I’m looking for some help on testing whether there are statistical differences between proportions when the data is dependent. By dependent, I mean that all the data is from the same participants ...
1
vote
1answer
743 views

Are binomial and McNemar's tests right for my data?

I have performed an experiment, where I have real and synthesised movie data. My participants were shown either a real movie, or a synthesised movie (of talking heads), in a random order, and had to ...
3
votes
2answers
5k views

Determine if two proportions from the same sample are different

Is there a test I can use to compare two proportions from the same sample that are not mutually exclusive? For example, I would like see if the proportion of people that answered "yes" to a ...
3
votes
1answer
2k views

Sample size function for McNemar test of repeated proportions in R

I have been scouring CRAN and Google for a function (that I wouldn't have to code myself) that would calculate the sample size needed for a pre-post design with a dichotomous outcome - to no avail. If ...
1
vote
0answers
76 views

Test for measuring change when you have same primary sampling units but different respondents in two waves of longitudinal survey

Which test should I apply for measuring change in proportions and means when I have same primary sampling units but different respondents in two waves of longitudinal survey? Should I apply McNemar's ...
2
votes
1answer
117 views

Determine if an action increases the proportion of 1s in binary data with unknown population

We're trying to improve search results, and we're trying to determine if certain changes (adding a word to a synonym list, removing it from the query, etc) have a statistically significant improvement ...
2
votes
1answer
1k views

McNemar's test for $3 \times 2$ data

I adopt a within-group experiment, such that the same participant uses 3 devices to perform a task, which has a result "pass" or fail. My data looks like this: ...
30
votes
4answers
46k views

What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each?

I have tried reading up on different sources, but I am still not clear what test would be the appropriate in my case. There are three different questions I am asking about my dataset: The subjects ...
3
votes
1answer
91 views

Which test should I use to assess for the statistical signficance of changes in multiple binomial dependent variables from T1 to T2?

Students have completed a test containing 20 questions at both T1 and T2, with an intervention in the interval. Scores for each question are either 0 (incorrect) or 1 (correct). I am interested in ...
2
votes
1answer
4k views

Paired comparison chi square

I have a question related to the use of chi square test for paired data. I have read that McNemar tests would be an option but in some software like R it works only for 2x2 data (may be I do not know ...
5
votes
1answer
12k views

McNemar-Bowker test for comparison of two measures

I am comparing two versions of a survey (an original, and a modified) and was wondering if the McNemar-Bowker test is appropriate. The survey(s) ask respondents to indicate whether they've had an ...
1
vote
2answers
321 views

McNemar's test with combined cell values?

I have 313 males and 356 females. Males and females each took two (gender specific) surveys (an original and a modified version). The survey I'm investigating is a measure of unwanted sexual ...
14
votes
2answers
3k views

Relationship between McNemar's test and conditional logistic regression

I am interested in the modeling of binary response data in paired observations. We aim to make inference about the effectiveness of a pre-post intervention in a group, potentially adjusting for ...
2
votes
1answer
760 views

Is McNemar's Test appropriate for evaluating pre-post differences in intervention studies with a control arm?

I recently came across a paper that uses the McNemar test to evaluate the effectiveness of an intervention to improve adherence to treatment. The study used a pre/post test design whereby the ...
0
votes
0answers
319 views

Need McNemar test for non-dichtomous variables (5x7)

I am looking to analyze nonparametric, related sample data using a test similar to the McNemar. My independent and dependent variables are not dichotomous (7x5). For example, if my IV was level of ...

1 2
3