All Questions
Tagged with hypothesis-testing proportion
269 questions
1
vote
2
answers
80
views
A test to check whether two sets of proportions are _not different_
Is there a test to check whether two small sets of proportions are significantly not different?
For example, consider the two sets of proportions
...
- 777
3
votes
1
answer
95
views
Reason for discrepancy in calculated $\chi^2$ value in this right-side preference while kissing problem
In the article Adult persistence of head-turning asymmetry, the author observed $ 124 $ couples. $80 $ of them kiss by moving their head to the right. Remaining $44$ move their head to the left.
When ...
2
votes
1
answer
69
views
How can I show statistically that one of my replicates is likely contaminated?
I have a dataset that looks like the below: five replicate samples, each of which is composed of 4 different fractions that sum to 100%. The fifth sample clearly looks visually distinct from the other ...
- 288
0
votes
0
answers
11
views
What test should I use for Weighted Mean Proportions?
I want to know if the "weighted mean proportion" of a racial group in the organization (overall) is significantly different from the "weighted mean proportion" of the group within ...
- 1
1
vote
1
answer
92
views
Statistical test to see whether one group is larger than the other
I have a data set that contains percentages of benefits provided in 2 groups from 2020 to 2023. Any statistical test I can use to test whether the percentages for group A are greater than the ones for ...
- 33
0
votes
0
answers
24
views
Repeated measurements of proportions with no information on individual subjects
I am working on a dataset (not mine) that includes repeated measurements of proportions, measured at 50 equally spaced time points. There are two groups. Group A has 65 individuals, and group B has 23 ...
- 61
0
votes
0
answers
25
views
What is the meaning of confidence intervals when NOT using sample data and instead have data on the whole population? [duplicate]
I'm trying to understand why you would need confidence intervals or compute statistical tests (for comparing proportions) when your data is NOT from a sample and you have data on the whole population.
...
- 77
0
votes
0
answers
19
views
Which statistical test for testing difference between two groups of normalized data/proportions?
I have two groups of data (treatment vs control) with 3 samples/replicates in each group. For each sample, I have n observations and for each observation I have quantified whether they are of type A ...
- 1
3
votes
1
answer
81
views
Testing if three proportions follow hypothesized ordering
I have a set of $n$ samples, and each sample $i$ is labeled with three binary characteristics $a_i,b_i,c_i\in \{0, 1\}$. I'm trying to test the hypothesis that the proportion with $a_i = 1$ is the ...
- 4,389
-1
votes
1
answer
31
views
Testing proportion differences between conditions
I've asked 10 people to choose between A and B in 3 different conditions and 5 times per condition (resulting in 5 data points per person for condition 1, 5 data points per person for condition 2 and ...
- 15
3
votes
3
answers
90
views
proper test for indifference of two groups
I'm reaching out with a question that, at first glance, might seem elementary, but given some perplexing advice from my thesis supervisor, I find myself in need of your expertise.
The scenario is ...
- 55
0
votes
0
answers
53
views
Two-proportion hypothesis test with variances unknown
"A group of test subjects are split into two groups. 1000 people are given a vaccine, and 15 of them get the disease. 800 people are given a placebo, and 60 of them get the disease. Test the ...
- 207
0
votes
0
answers
51
views
Best stats test for a resume audit study evaluating bias
I am testing an applicant tracking system and giving it resumes that have implicit mention of race, and asking the system to rank them.
There is a control resume with no implicit mention of race.
For ...
1
vote
2
answers
71
views
How do I use chi-squared test properly to compare between counts of a particular finding (single categorical variable) between two groups?
I have a list of endoscopic findings from my study and want to check if there is any statistical difference between the counts between two groups of patients. The number of patients in groups A and B ...
- 11
1
vote
2
answers
94
views
Testing if refusal rates are "correlated" between 3 judges
I have data looking like this:
group
refusal proportion (judge A)
refusal proportion (judge B)
refusal proportion (judge C)
group 1
0.2
0.3
0.05
group 2
0.1
0.5
0.6
group 3
0.6
0.9
0.7
group 4
0....
- 57
3
votes
1
answer
69
views
Proportion test under the null hypothesis
In the code below, two binomial responses are simulated with the same probability of success ($H_0$) and the p-value of the 1-sided z-test is stored. This is repeated 10000 times.
...
- 2,237
1
vote
1
answer
100
views
Two sample proportions: How to test the hypothesis that the difference in proportions is less than a specified threshold?
Say I have treatment and control, perfectly randomized.
I have 70000 conversions for treatment in 80000 users.
I have 70100 converions for control in 800100 users.
My null hypothesis is that there is ...
2
votes
1
answer
55
views
When failing to reject a null hypothesis can we also calculate the probability of observing the treatment assuming the alternative is true?
Say we have a null hypothesis, $H_0$ that there is no difference in the proportions between two arms of an experiment. You power the test to alpha and beta levels such that your $H_1$ MDE is 1% ...
1
vote
0
answers
32
views
Joint testing of proportions, analogous to the Hotelling $T^2$ test?
Hotelling's $T^2$ test examine if two multivariate Gaussian distributions with the same covariance matrix have the same mean vector. Assuming the two distributions to have the same covariance matrix ...
- 67k
1
vote
0
answers
25
views
Appropriate tests and normalization approaches for highly non-normal data
I'm trying to ascertain whether a particular type of article, $T$, is associated with higher engagement scores in academic journals, and how substantial the effect size might be. I have raw data of ...
- 323
2
votes
0
answers
17
views
A statistical test for proportions in two groups and in > 2 groups
I have two outcomes given a population of people.
report a headache
report a migraine
And all those people are broken into two sets of groups.
by sex (male and female)
by deprivations score (1, 2, ...
- 605
0
votes
1
answer
57
views
What significance test should I use?
Every animal farm needs to be verified by its city council in a regular time frequency, which could be every six months or 12 months. We report how many farms nationwide which fail the verification ...
- 3
1
vote
1
answer
69
views
2 proportion Z/T test?
I want to find out if 2 proportions are different or not.
For one, sample size is <30.
For the other, it's much >30.
Can I use the Z test since one size is large? Or do i have to use the t test? ...
0
votes
1
answer
35
views
How to perform a proportion test comparing noise proportions in different groups?
I have a dataset containing observations of wave lengths in milliseconds and the corresponding durations of noise in milliseconds. Each observation is labeled with a group (A or B) and a subject.
I ...
3
votes
1
answer
35
views
At loss regarding a suitable hypothesis test for proportions in the same population
I'm dealing with a population where there are $5$ categories $A, B, C, D, E$ and I would like to make the claim that $A$ is the most common category in the population (i.e., the most frequent).
I ...
- 238
1
vote
0
answers
38
views
I am looking for the right significance test for a questionnaire
I have a questionnaire to check the implementation of several recommended health improving measurements. It will look approximately like this:
Did you do your 20 minute Yoga routine on a daily basis?
...
- 89
0
votes
0
answers
98
views
Hypothesis test for proportion falling below a threshold
Let's assume the following Null and Alternative hypothesis of a proportion:
H0: $p < 0.01$
H1: $p \geq 0.01$
Generally, in ...
- 1
4
votes
1
answer
78
views
Binomial proportion test
I'm really confused about a basic test for a binomial proportion. Specifically, the p-value. If $n=20$ with $y=17$ successes, I want the p-value for $H_0: \pi\leq 0.7$ vs. $H_A: \pi > 0.7$. I've ...
- 555
2
votes
1
answer
130
views
What test to perform if I have percentage data
I have the following percentage data from multiple samples, and a corresponding reference percentage. Which test should I perform to test whether the percentage from the samples is different from the ...
- 41
0
votes
1
answer
127
views
Chi square goodness of fit test or individual test for proportion or both
I have dataset which looks like below -
Categories
Sample 1
Sample 2 ....
Sample 9
Reference Proportion
A
89
91
85
0.89
B
0
1
3
0.01
C
2
1
1
0.02
...
6
8
7
0.06
I
1
2
1
0.005
I want to test ...
- 41
2
votes
1
answer
160
views
Making sense of a reviewer's "30 observed counts minimum per cell" requirement on a contingency table
I'm perplexed by the comment of a reviewer, who has taken issue with the sample size from a study I conducted. He says, relatively to the 2X2 contingency table below and a (significant) 2-sample test ...
- 5,848
2
votes
0
answers
135
views
Z-test with large sample sizes but small proportions
I'm running an A/B test to determine if a change/treatment we're proposing for our website has an impact on users opting into a specific (niche) category of notifications.
To do so, I'm performing a ...
- 21
0
votes
1
answer
36
views
Conflicting answers in R depending on if the proportions test is two sided or one sided
I want to investigate if the conversion rate(proportions) for system A is significantly different from the conversion rate of system B. $\mathcal{H}_0 = $ there is no significant difference of ...
- 363
0
votes
0
answers
73
views
Power analysis of group proportions when sample sizes cannot be guaranteed to be equal
I have a new UX feature, which I need to test out on users on a social media platform. When a user creates a post, he/she can add hashtags to gain community traction. As owners of the platform, we ...
- 3,520
2
votes
0
answers
1k
views
Dealing with a warning message from prop.test in R
I did a prop.test for my data and I got this warning message :
...
- 309
0
votes
1
answer
132
views
Appropriate test for proportions data
I want to compare how my computation model performs to the experimental data. For the experimental data I have proportions of different type of cells like the below table -
Cell Type
Proportion
Type ...
- 41
1
vote
1
answer
837
views
Hypothesis test for difference-of-differences of proportions?
I know how to perform a test of the difference between two proportions. This is one level more complex than that. I have an experiment in which participants (male or female) are randomly assigned to ...
- 11
1
vote
1
answer
95
views
Hypothesis testing for ordinal proportions for multiple independent subjects divided between two groups
I have two biological groups - each with multiple subjects (7 in one and 10 in another). Each subject provides 40-80 observations, which can be classified into either of two ordinal categories. I have ...
- 11
6
votes
1
answer
196
views
Testing the difference of proportions equal to a certain value
Suppose there are two samples $X_1\dots X_n$, $Y_1\dots Y_m$ of binary variables $X\sim Bern(p_1)$ and $Y\sim Bern(p_2)$.
Is there any way to test the following hypothesis by the exact test?
$$H_0: ...
- 351
2
votes
3
answers
78
views
Detect dramatic increase in proportion among multiple classes
I would like to use some tool to detect spike in one class's proportion.
Assume I received roughly the same percentage of red, blue and yellow candies throughout time. That means the absolute number ...
- 21
2
votes
1
answer
102
views
What's population, what's sample, in a website conversion hypothesis test?
Context
I am a marketer; and I run marketing campaigns and website design tests a lot.
There are many tools - such as online A/B testing calculators - out there to help me test the statistical ...
- 119
6
votes
3
answers
1k
views
Computing p-value vs. constructing confidence interval from sample for proportions
Let's say D is a Bernoulli distribution with parameter $\mu = 0.6$ and we want to test whether or not $\mu=0.5$. So,
Null hypothesis: $\mu = 0.5$
Alt hypothesis: $\mu \neq 0.5$.
Suppose we have a ...
- 273
1
vote
1
answer
2k
views
Central Limit Theorem for proportion - np >=10 or 5?
While trying to understand deeper about Central Limit Theorem for proportions, I learned CLT for proportions is based on the fact that binomial distributions can be approximated by normal ...
- 119
2
votes
1
answer
434
views
What statistical test to use to say frequency of one sample is higher/lower than the frequencies in other samples?
I have the following table,
I used chi square test of independence to find whether the frequencies of 'c.388A>G' are same across SAMPLE_A, SAMPLE_B and SAMPLE_C. And the p-value from the test ...
- 863
1
vote
1
answer
697
views
Statistical test for multiple proportions
I'm struggling with finding a proper statistical test for my problem. My data is the following: imagine a set of 5 independent samples, and for each sample I can count 10 species populating it. Each ...
- 23
0
votes
1
answer
239
views
How to statistically compare changes of two percentages
I plan to conduct an experiment with one between-subjects factor with two levels (control vs. treatment). Respondents will be asked to choose among three options (A vs. B vs. C). (FYI, I plan to ...
- 3
1
vote
1
answer
290
views
Statistical test to compare teachers of students taking tests
Suppose I have two teachers $T_1$ and $T_2$, who teach students $S_{11}, S_{12}, \dots S_{1n}$ and $S_{21}, S_{22}, \dots S_{2n}$ who then answer questions $Q_1, \dots Q_m$, giving us two $n \times m$ ...
- 141
1
vote
0
answers
53
views
How to statistically compare the frequencies of two different words in a single corpus
Suppose I have a large corpus of text data and I would like to compare the frequencies of words $w_1$ and $w_2$. How would I go about testing whether or not their respective frequencies, $f_1$ and $...
- 11
1
vote
1
answer
16
views
Significance of 0 error results
I want to see how many people have COVID in a certain region (London) and I use a sample of 10 people out of 1000 (btw the sample size isn't an issue) and test them for COVID and find that none of ...
- 11
1
vote
1
answer
172
views
2 Treatments, comparison of proportions. Z test?
My design is the following: two treatments, T1 and T2. Population is divided in 4 age brackets, and the absolute numbers of enrolled subjects are:
Age
Treat1
Treat2
12-39
1387907
12196048
40-59
...
- 23