Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

109 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
2k views

How to best approach ANOVA with multiple response variables that might be correlated and Bonferroni Correction

I need some help verifying a simple analysis. I have completed a simple two factor experiment of more or less equal sample sizes. Let's assume for the case of this question that the sample sizes are ...
3
votes
0answers
44 views

Bonferroni corrections for multicollinear data

I am trying to do multiple ANOVA tests testing a single response against about 7 different explanatory variables in turn. Obviously, I need a Bonferroni correction here, but I'm unsure how to use it. ...
3
votes
0answers
180 views

Comparing the mean of several exponentially distributed variables

(Possibly related to Is there a nonparametric equivalent of Tukey HSD?) Given a set of several exponentially distributed variables (representing data which is modeled this way), I'd like to check ...
2
votes
0answers
35 views

When to apply Bonferroni correction?

I have 2 conditions, each with 2 factors, making 4 combinations. For each of these 4 combinations, I measure 6 variables. For the sake of illustration, let's say I'm measuring the 'quality' of leaves ...
2
votes
0answers
53 views

How to derive Bonferroni's Inequality using Boole's Inequality?

I'm trying to derive Bonferroni's inequality using : $$P(\cup^{\infty}_{i=1} A_i) \leq \Sigma^{\infty}_{i=1} P(A_i)$$ for any sets A_1, A_2, ... (Boole's Inequality) The result I want is (Bonferroni'...
2
votes
0answers
98 views

Multiple testing on the same dataset

I have a dataset with n = 76 independent test subjects (rows) and 3 dependent variables (columns) (which are related as a process taking place over time). For the example below I will assume I have ...
2
votes
0answers
10 views

Can and should you avoid implicit pretesting for differences in group means?

Suppose I have a population with four (or more) disjoint sub-populations which differ from one another by traitishness, the union of which is the whole population. I have an outcome measure on the ...
2
votes
1answer
30 views

Multiple hypothesis test

I have some questions about multiple hypothesis test. Situation 1: We have 1000 p-values, all of them are less than 0.0 5. We may say there are 50 false positive (1000*0.05) in these p-values. ...
2
votes
0answers
66 views

Fisher Test and corrections for multiple comparisons

When I do 4 comparisons (namely 4 groups of data) using Fisher test, do I have to correct the results for multiple comparisons (therefore reducing the accepted p for significance to everything below 0....
2
votes
1answer
85 views

Models comparison and multiple testing correction

I have 4 models for a learning task, and I am performing pair-wise tests between them, on five metrics, to asses whether they present different distributions. How should I go about multiple testing ...
2
votes
0answers
190 views

DO I need Bonferroni correction for ANCOVA analysis repeated 10 times?

I have 2 groups, and are comparing them using T Test, and ANCOVA (with covariates), and am repeating this with 10 dependent variables (9 subtest scores and 1 overall test score. Do i have to use ...
2
votes
0answers
81 views

Multiple A/B Tests on same population

I ran the same A/B test three times in a row for an email campaign. For each test I assigned a person to one of two groups (variation 1 or variation 2) randomly. This way it could have happen that ...
2
votes
0answers
585 views

a priori power analysis for ANOVA plus post hoc test

I would like to perform an a priori power analysis to calculate required sample size for data to be analyzed using one way ANOVA and Tukey HSD post hoc test. (I want to determine pair-wise which ...
2
votes
0answers
109 views

Multiple Hypothesis Testing with Categorical Variables and Alternatives

Suppose we have a variable $Y_i$ which is a binary categorical variable, and we have a variables: $X_{i,1}$, $X_{i,2}$, ....$X_{i,n}$ ($i=1,2,....N$ where $N$ is sample size, and $n$ is the number of ...
2
votes
0answers
462 views

How is plot of p-values distribution related to calculation of the false discovery rate?

I'm running t-tests for all combinations of pairwise comparisons of average length of stay for patients among 30 hospitals. My first approach was to use a Bonferroni corrected significance level of ....
2
votes
0answers
20 views

Appropriate correction for tests for determining best of family

I have a sample of $N$ instances of a problem (assumed to be independent samples of an infinite population of instances). To each of these instances I apply $M$ methods, and record how quickly they "...
2
votes
0answers
191 views

Multiple Comparisons Correction on Peason's Chi-Squared Tests

I have a dataset consisting of 1000 samples (rows). Each sample consists of 300 categorical data points (columns). The process of generating these data points has a known probability of generating an ...
2
votes
0answers
161 views

Bonferroni Multiple comparisons — testing for any true

I am doing multiple comparisons with several thousand independent alternatives. None are statistically significant when Bonferroni corrected; however, many more are significant when uncorrected than ...
2
votes
0answers
74 views

Is this a valid method to control the FWER?

I have a huge number, say $M$, of hypotheses that are potentially correlated. I have a dataset $D$ of random samples from an unknown distribution and I want to do test the hypotheses for significance ...
2
votes
0answers
3k views

Bonferroni correction in generalised linear model

I am running a generalised linear model in R. I have a single response variable and a maximum of 4 possible explanatory variables. I am adding each explanatory variable to the model sequentially, ...
2
votes
0answers
899 views

Multiple comparisons process using Kruskal-Wallis, G-Test and corrections

I want to know if changing a button color has a positive effect on different measures (see the 4 measures below), using the following process: There's a default button, which is the fixed control ...
2
votes
1answer
317 views

How to describe three groups where the means of two groups are significantly different, but neither of the two groups differ from a third group?

I am comparing 3 means from normal distributions using student's test: $\mu{_1}, \mu{_2}, \mu{_3}$ Results are: $\mu{_1} = \mu{_2}, \mu{_2} = \mu{_3}, \mu{_1} \ne \mu{_3} $ If I want to group my ...
1
vote
1answer
24 views

Can we use the binomial distribution instead of Bonferroni correction for large number of independent significant tests?

Supposing we are doing e.g 1000 one-sample t-tests with the null hypothesis that all population means are 0, with significance level 0.01. One common method for dealing with the number of tests is to ...
1
vote
0answers
26 views

Corrections for multiple hypothesis testing

Apologies if this repeats a previous query, I have read a lot of prior threads (and made myself a bit cross-eyed with the ones asking whether we should correct for every hypothesis test ever performed!...
1
vote
0answers
17 views

Possible multiplicity issues in equivalence testing

I'm currently looking to compare 3 groups, trying to prove equivalence between them. For this, 5 specific parameters are measured for each group, and a pairwise comparison for each parameter among the ...
1
vote
0answers
12 views

Adjust for multiple comparisons in regression with one outcome variable and several independent variables?

How do I adjust for multiple comparisons using FDR with linear mixed effects first regression: ...
1
vote
0answers
50 views

Comparing different samples from different years: ANOVA?

I have been collecting data for 10 consecutive years. Once in each year different participants (N=110/Year) had to rate the importance of each one of 30 different social values, on a Likert scale (1-5)...
1
vote
0answers
23 views

Multiple testing between treatment groups, and between subgroups within treatments. Bonferroni correction required?

I have a data set that is structured such that I have four treatment groups with 6 samples each; 3 samples in each treatment were taken at an early time point, and the other three were taken at a ...
1
vote
0answers
34 views

Why is the Tukey method not appropriate for covariance analysis when estimating treatment effects?

In the book 'Applied Linear Statistical Models' chapter 22 it states that the Tukey method is not appropriate for covariance analysis. The context is in estimation of treatment effects. Instead, when ...
1
vote
0answers
7 views

Should multiple adjustedment correction be applied here?

I have a question. I'm analysing an article for an assignement. In this study there are two groups (normal d-dimer vs elevated d-dimer). The study compaires the mean of the groups for multiple ...
1
vote
0answers
33 views

Do I have to correct for multiplicity twice if I re-run a comparison with one more hypothesis during incremental testing?

Let's say I have a set of hypotheses ordered in time. These are about comparison to some baseline moment: $H_{t1 vs. baseline}$, $H_{t2 vs. baseline}$, $H_{t3 vs. baseline}$, ... I have 10 time ...
1
vote
0answers
29 views

Need of p-value adjustment when analyzing all possible pairs of factor levels in linear model

I have a nominal (not ordinal) variable with $K$ levels (these are actualy some groups of patients) and I run linear model in which: this nominal variable is one of IV's (others are age, sex and so ...
1
vote
0answers
68 views

3 way ANOVA / Duncan test

I am runnig 3 way ANOVA between: specie * organ * treatment in Sucrose acumulation. There is interaction between organ*treatment, but no interaction between specie and organ or treatment. Should I ...
1
vote
0answers
57 views

Bonferroni confidence region for shifted Laplace parameters

Consider the shifted Laplace distribution with the density: $$f(y)=\frac{\theta}{2}e^{-\theta|y-\mu|}\quad, \quad y\in \mathbb R$$ Using the Bonferroni method, construct a $100(1-\alpha)\%$ ...
1
vote
0answers
995 views

Pairwise comparisons after ANOVA with Tukey and Bonferroni methods in r

The built-in functions TukeyHSD and LSD.test from R perform pairwise comparisons. In order to maintain the type I error, the significance level $0.05$ is divided by the number of comparisons $k$. Do ...
1
vote
0answers
181 views

FIsher's LSD test is appropriate for restricted mean comparisons

Suppose that we perform two way ANOVA with interactions, with factors $A$ and $B$ with three level each $A_{1},A_{2},A_{3}$ and $B_{1},B_{2},B_{3}$. We know that Fisher's LSD test is used for ...
1
vote
0answers
128 views

Chi-square difference test: how to adjust for the number of tests?

How should I adjust for the number of tests I do when using the chi-square difference test, where the null hypothesis of the test is that two models do not differ? I am using this test in the context ...
1
vote
0answers
119 views

How and when to use multiple comparison tests

There seems to be some variability in WHEN multiple comparison tests such as Bonferroni or FDR might be implemented. Type 1: One might carry out multiple one-way ANOVA's to see whether or not there ...
1
vote
0answers
97 views

How to use Bonferroni correction - correct by no of parameters? No of models per dependent variable?

I have a simple question about when corrections such as Bonferroni should be applied. Say I have a research question for which I have three separate dependent variables, and run three separate models ...
1
vote
0answers
214 views

How to apply Bonferroni correction across multiple regression experiments?

I have 5 variables: A, B, C, and D. A and B are two different scales and are my dependent variables. C (categorical) and D (continuous) are fixed effects. C is also a categorical variable having 3 ...
1
vote
0answers
418 views

Do I have to apply Bonferroni correction for U-test

I believe my question might be quiet easy for you to answer. I tried to do some research on that topic myself but failed to come to a conclusion. If I understood correctly, Bonferroni correction is ...
1
vote
0answers
20 views

Random trial with questionnaire and multiple answer/outcome: Should the p-value be adjusted?

I have randomly allocated person into two groups, a control and intervention group. Each of the person I ask 8 questions (=hypothesis). At the end I want to compare if there is a difference between ...
1
vote
0answers
654 views

Bonferroni correction in independent samples t-test?

I have three IVs with two levels/groups. My primary hypothesis is that there will be group differences for all IVs in total score. However, total score is comprised of scores on 7 subscales. Total ...
1
vote
0answers
529 views

Dunn-Bonferroni: All three differ significantly?

I have this huge knot in my head while writing my thesis atm. I am totally untalented when it comes to statistics, so it could be that my question is easy to answer for some of you. I did a Kruskal-...
1
vote
0answers
559 views

How to perform multiple noninferiority tests with linear mixed models?

I want to test a theory that predicts that certain measures are greater than or equal than others. Consequently, I want to perform noninferiority tests. Furthermore, I want to get rid of some ...
1
vote
0answers
212 views

Do I need to use a Bonferroni adjustment after a MANCOVA?

My thesis supervisor insisted I do a MANCOVA with 5 dependent variables. However to answer my research questions I need to use the results of the subsequent 5 univariate tests SPSS automatically ...
1
vote
0answers
48 views

Multiple testing correction - how to adjust for number of tests

Let's say I have criteria A to select 1000 variables of interest and run a 1000 hypothesis tests on these. However, I could use criteria B to select another 500 variables from a larger list of ...
1
vote
0answers
1k views

Using Likelihood Ratio Test and Bonferroni Correction with a Linear Mixed Effects Model with Random Intercept in R

This is my first time asking a question here, so please forgive any issues in clarity. I am also a newbie, so hopefully this makes sense! I am interested in comparing multiple regions of interest, a ...
1
vote
0answers
110 views

Checking assumptions of proportional hazard model in a multiple imputed setting

I would like to check the proportionality assumption of a proportional hazards model. The problem is that I am doing multiple imputation. I have checked the assumption in every one of the imputed ...
1
vote
0answers
524 views

multiple test correction procedure for survey data

I clustered ~ 20,000 students into three groups. Now, I also have answers from some of those students to ~ 100 survey questions. I would like to compare the differences between the clusters regarding ...