Questions tagged [bonferroni]
Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.
389
questions
0
votes
0
answers
46
views
Definition of 'independence' of comparisons in Multiple-Comparison - Bonferroni Adjusted Standardized Residuals for Chi-Squared Test
I have provided a hypothetical example to illustrate my question. Assume an alternate hypothesis for a difference between two variables of interest (arbitrary for the example), analyzed with a chi-...
0
votes
0
answers
26
views
Bonferroni correct Application
This might be a super simple question but I cant seem to find an answer. The issue I am comparing 2 shoes at 3 speeds and their impact on a dependant variable. Therefore lets say shoe1/speed1 = A; ...
- 21
1
vote
0
answers
16
views
Bonferroni application [closed]
My dataset compares the impact of 2 shoes at 3 speeds on a dependant variable. When it comes to post hoc pairwise testing I would look at
shoe1 vs shoe2 at every speed
speed 1 vs speed 2; speed 2 vs ...
- 21
0
votes
0
answers
19
views
Do I need to apply the Bonferroni correction test if it's different tests on different dimensions but generated by the same agents?
I am running an AB test on a customer support tool - I have changed one feature in the support tool. My unit of randomisation is the agent solving tickets, and my unit of measurement is tickets solved....
- 1
0
votes
0
answers
19
views
Multiple testing with Wilcoxon signed rank test with set maximum length
I'm essentially performing this test with the Java Apache math3 method which only allows lengths up to 30. My pairs will have a length of maximum 2048. I will be testing for an increase (combination ...
2
votes
1
answer
47
views
KPSS test with Bonferroni Correction. alpha < 0.01
I want to apply a Bonferroni correction on multiple KPSS tests for stationarity. I have $m$ tests, and so I want to see if the p-values are less than $0.01/m$.
The problem is that the statistical ...
- 155
1
vote
0
answers
20
views
Alternative to Bonferroni Correction for Dichotomous Variable? [closed]
I am working with a dichotomous variable and my supervisor has asked me to apply a Bonferroni correction to our data using SPSS. From my understanding, Bonferroni corrections are used when performing ...
- 67
0
votes
1
answer
22
views
Is that necessary to do multiple test correction on mediation analysis
I'm doing a mediation analysis to find the 'significant' mediator between variables X and Y. I have 4 potential mediators (M1,M2,M3,M4) and I conducted 4 univariate mediation analysis. More ...
0
votes
1
answer
48
views
Bonferroni correction, alpha and C.I [closed]
For multiple comparisons, Bonferroni corrections are made. Depending on the number of pairs of comparisons, the level of significance is adjusted. For instance, for 4 pairs of comparisons at 95% C.I., ...
- 11
0
votes
0
answers
28
views
Multiple testing correction for multiple 2-way anova testings
I run two-way mixed ANOVAs to examine the effect of factorA (between-subject factor: 3 levels) and factorB (within-subject factor: 2 levels) on outcome variables. I then perform simple effect analysis ...
1
vote
1
answer
102
views
Non-parametric test for comparing means of 2 or more dependent variables in R?
I have a matched paired dataset (student survey before a topic was taught and student survey after the same topic was taught) where I compare the means of their answers (answers are given in Likert ...
denise
0
votes
0
answers
9
views
Correcting for multiple hypothesis when using discrete choice models
I was wondering if anyone knew if there was any guidance regarding correcting for multiple hypothesis (using for example Bonferroni correction) when using discrete choice models (for example MNL or ...
- 1
0
votes
0
answers
29
views
Does the Holm-Bonferroni procedure really correct for FWER in the context of ANOVA?
I wanted to make sure that post-hoc tests with the Holm-Bonferroni procedure behave nominally on typical ANOVA data under the null hypothesis.
To do so, I computed the p-values and FWER obtained from ...
- 33
1
vote
1
answer
33
views
Meta analysis: can multiple test corrections (i.e. Bonferroni) be applied on the pooled effect p-value?
I plan to do a meta-analysis including the effect size of each cohort as the objectives. I'd like to ask if I could apply multiple test corrections (i.e. Bonferroni) on the pooled effect p-value.
I ...
- 21
0
votes
0
answers
28
views
Do we need to apply "multi-testing" corrections for the p-values in a regularized model?
Say we are fitting a penalized model, such as a linear regression with lasso regularization. We expect to obtain a model with the most significant covariables.
The method starts with many covariables ...
- 1,034
1
vote
1
answer
26
views
Bonferroni Correction: Independence vs Disjoint Events
Let $T_i$ and $c_i$ be a test statistic and critical value, respectively, for testing hypothesis $H_i$, $i = 1,2,\dots, n$. Assume a Type-1 error rate of $\alpha$ for each test. The family-wise error ...
- 260
1
vote
1
answer
28
views
family wise error rate in highly dependent data
I was hoping someone could help with a problem in my area of Optometry. We use visual fields/perimetry to assess patients visual function. This consists of patient responses (or not) to points of ...
- 31
1
vote
0
answers
7
views
posthoc paired t test
Is there a website with a calculator to input 2 sets of data to perform the post paired t test adjusted with the Bonferroni correction? Or is anyone available to hire?
- 11
0
votes
1
answer
26
views
Pre-specified comparisons procedure: How comparisons can be made without looking at the data
The section "Bonferroni Comparisons" in the book Applied Statistics for Engineers and Scientists, Petruccelli at el. (1999), the authors wrote:
Bonferroni intervals are ideal for making a ...
- 13
4
votes
1
answer
305
views
Bonferroni corrected p-values that exceed 1: possible or non-sense?
My question concerns the Bonferroni correction of p-values. In my analysis, I would like to multiply the obtained p-values by N, where N is the chosen number for the Bonferroni correction, such as 2, ...
- 205
1
vote
0
answers
117
views
How to correct for multiple testing in linear mixed models?
I want to correct for alpha error accumulation for my 10 crossed linear mixed models. The random parameters are specified as follows: random intercepts for subject and stimulus and a random slope for ...
- 11
0
votes
0
answers
94
views
Propper correction for multiple Fisher's exact tests
I am trying to identify a list of features that are significantly over represented in one population when compared to the other. Experiment is designed such that I have two groups of individuals A and ...
- 1
2
votes
1
answer
52
views
Bonferroni correction: Whats exactly is meant by "multiple tests"? [duplicate]
The Bonferroni correction seems to be quite controversial. But I read again and again that it should be used for multiple tests. But what exactly are multiple tests? If I have three different data ...
- 89
1
vote
0
answers
34
views
Why is an alpha adjustment not required for factorial ANOVA?
When conducting a 2-way fixed effects ANOVA, there are essentially four null hypothesis statistical tests (NHSTs) that can reasonably conducted with just the ANOVA tables. The first is the omnibus ...
- 5,314
0
votes
0
answers
46
views
Adjusted p-value for conducting 7 linear regression models?
I am looking at factors that are associated to changes in student's grades over time. My dataset consists of 45 students with Time 1 and Time 2 grades across 7 different subjects as well as ...
1
vote
1
answer
95
views
How to get the group differences after Bonferroni correction in multiple comparison?
After an ANOVA in R, do you know if it is possible to get the group differences using Bonferroni correction ?
If I use the iris dataset
...
- 169
0
votes
0
answers
36
views
ANOVA: which test is to be chosen when they differ in significance?
I am using the software PAST*.
When running an ANOVA I have available these tests: Tuckey's pairwise, Kruskal-Wallis, Mann-Whitney pairwise and Dunn's post hoc.
I am trying to see if three species are ...
- 31
2
votes
2
answers
67
views
In a muddle with Paired Samples t-tests on pre vs during vs post
I have used paired samples t-tests to compare 3x time-point measurements, A/ B/ C.
A and B t(102)=4.988 p=.000
A and C t(102)=4.939 p=.000
B and C t(102)=.346 p=.730
A, B, and C were all significant ...
0
votes
1
answer
112
views
Reviewer is requesting the use of Bonferroni adjustment to alpha in G*power calculation ("multiple regression" with 3 predictors)
Since Bonferroni is intended as a (conservative) adjustment to reduce Type 1 error, I'm unclear why it would be required by the reviewer to adjust alpha in the power calculation (using G*power). While ...
- 1
0
votes
0
answers
27
views
Paired t-test - test significance of one group to all other groups
Using a paired t-test, is it possible to test only one group against all other groups instead of testing each pair of groups against each other? If yes, would bonferroni correction work the same way ...
- 45
4
votes
1
answer
343
views
Questions about Dunn's test
Authors in a paper state that they use the 'Bonferroni-Dunn test' as a post-hoc test. Is the 'Bonferroni-Dunn test' just a Dunn's test with Bonferroni adjustment or is it a different test (after ...
- 45
0
votes
0
answers
34
views
Bonferroni correction for posteriors/ Post inference adjustments to Bayes Factors
I manage an experimentation platform that has succesfully gotten a Bayesian approach to experimentation in production.
One new feature we want to implement is to do inference for multiple metrics (e.g....
- 115
0
votes
0
answers
33
views
Why should we specify statistical analysis a priori? [duplicate]
I understand that multiple post hoc comparisons increase the likelihood of finding spurious associations, but I'm looking for an explanation of how exactly Type 1 and Type 2 errors are affected by not ...
- 1
0
votes
0
answers
19
views
How to control for multiple comparisons when using zero-inflated poisson models?
I'm modeling the relationship between demographic variables and resource use (resource use ~ demo1+ demo2 + ...). I am doing this for 56 different resources -- so I have 56 models.
A zero-inflated ...
- 1
0
votes
0
answers
134
views
Should I favor the results of a Hotelling's $T^2$ or Bonferroni confidence interval?
I am trying to understand if my reasoning is correct about these two methods. Faced with a situation where it is impossible to get both methods to fail to reject the null hypothesis, which should I ...
0
votes
0
answers
17
views
Correcting for multiple comparisons repeated-measures design
I have a question regarding correcting for multiple comparisons in my design; participants were presented with 2 vignettes each describing a person, and for each vignette each participant had to ...
0
votes
0
answers
28
views
FWER adjustment
I want to use the built-in ToothGrowth dataset in R to write an assignment and conduct t.test...
2
votes
3
answers
142
views
One-way ANOVA for multiple features?
I have 60 continuous features (i.e., lab results) for 35,000 patients, and the patients are divided into three groups. I want to evaluate each feature to find out what the differences are between the ...
- 21
4
votes
2
answers
61
views
Does the Prospective-Alpha-Allocation-Sequence (PAAS) actually control the family-wise error rate?
I recently read about the PAAS as an alternative to Bonferroni. Unlike Bonferroni, where $\alpha$ is subdivided among multiple tests such that
$$ \alpha_1 + \alpha_2 + \ldots + \alpha_k = \alpha $$
...
- 59.4k
0
votes
1
answer
159
views
Does Scheffe always show wider confidence bands than Bonferroni?
Bonferroni simultaneous confidence intervals are built for finite parameters, while Scheffe simultaneous confidence intervals are built for infinite parameters. Intuitively, Scheffe will produce wider ...
0
votes
0
answers
31
views
In a Anova Bonferroni post-hoc test how would you explain the mean difference?
How would ypu explain the interpreted difference to someone unfamiliar with this kind of research?
Specifically the mean difference between divorced and widowed
I don't understand what the mean ...
- 1
2
votes
2
answers
305
views
Post-hoc test for chi squared goodness-of-fit test: understanding Bonferroni
I have seen this, but it doesn't help me here.
Here is my setup:
I have four categories, and want to simultaneously test whether p_1 = 0.4, p_2 = 0.35, p_3 = 0.15, p_4 = 0.10. I am using a chi squared ...
- 676
0
votes
0
answers
31
views
Multiple comparisons problem in adjacent data comparison
I partitioned data by age like this:
first_data(0-1 years),
second_data(2-3 years),
third_data(4-5 years).
Each is not normally distributed.
I want to compare adjacent data only, that is first_data-...
2
votes
2
answers
145
views
Need for bonferroni correction
I need help understanding if I need to / how to apply a bonferroni correction!
I have one continuous variable and three unrelated groups that have completed scores on this variable (Groups: A,B,C). I ...
- 31
1
vote
1
answer
139
views
Bonferroni (or BH) correction for multiple t-test?
I'm studying the kinematics differences between males and females examined at two different specific walking speeds (slow/fast). Specifically, I'm exploring:
a) slow speed vs high speed (dependent t-...
- 23
0
votes
0
answers
187
views
How to run a post-hoc correction test on multiple chi-square test?
I have run chi-square tests on occurrence of species across two time periods. As I have 1300 species I analysed them in bulk using a multiple loop function in R:
chitest1<- t(sapply(seq(nrow(...
- 1
0
votes
1
answer
42
views
Boxplots t tests and Bonferroni correction
I'm comparing three groups: people that have had two infections, people that have had one infection and people that have had zero infections.
I'm showing them on a boxplot (regarding age for example) ...
1
vote
2
answers
49
views
Hochberg/Bonferonni correction for multiple one-sample t test
I am trying to conduct a content validity analysis where I want to test if a certain item (e.g. a question) can be related to a certain construct (e.g. depression). I've let people fill in a ...
- 329
2
votes
1
answer
3k
views
How can I manually calculate the Bonferroni correction?
I created a statistical model with one categorical factor with six levels and performed a posthoc test to obtain the significance level for every contrast (15 comparisons). I wonder if I should apply ...
- 21
1
vote
1
answer
61
views
Significance levels for multiple testing adjusted p-values
May I ask what is the conventional significance levels for multiple testing adjusted p-values (no matter Bonferroni or Holm or Sidak)? For unadjusted p-values, many researchers use * 5%, ** 1% and *** ...
- 13