Skip to main content

Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

Filter by
Sorted by
Tagged with
0 votes
0 answers
16 views

Appropriate way to correct for multiple comparisons in this case

I am trying to compare the performance of an optimisation algorithm on different objective functions. The functions can vary in their form (4 different types) and dimension. I would like to first ...
ufghd34's user avatar
2 votes
2 answers
42 views

Bonferroni correction necessary? regression to predict ONE outcome

I am working on a project with a small sample size where I have multiple predictors at baseline and one IV. I am trying to see if any of the DVs are good predictors for the score on the IV (continuous)...
user418492's user avatar
0 votes
0 answers
22 views

The problem of double adjustment of p-values in multilevel models with categorical predictors

I have a set of around 30 multilevel models which have the same predictor variables (and the same cluster variable), but different outcome variables. Since there are so many models, I want to perform ...
J. Doe's user avatar
  • 357
0 votes
0 answers
12 views

external internal validation and chi square

The internal test set, created from 20 percent of the train data set, consists of 'a' and 'b' labels. I take the 'a' labels from the internal test and combine them with the 'c' group of another ...
Nemo's user avatar
  • 1
0 votes
0 answers
17 views

Bootstrapped Confidence Intervals controlling for FWER?

I'm currently using the bootci package in MATLAB to compute bootstrapped confidence intervals. I have data for two variables and I'm interested in comparing differences in means of these variables. ...
pinpss's user avatar
  • 1
0 votes
0 answers
41 views

When to use an adjustment method for Kruskal-Wallis + Dunn's and which method?

I need to do multiple pairwise comparisons among 5 groups (Treatment 1, Treatment 2, Treatment 3, Positive Control, Negative Control) for different tests and times. Each group has $10$ individuals, ...
Antonella's user avatar
4 votes
2 answers
454 views

multiple linear mixed models - multiple comparisons adjustment

I recently started to work on a case-control study using repeated measures over time (Modeling repeated measures data in R - Interpretation and Validation). I have several dependent variables and I ...
Ed9012's user avatar
  • 391
2 votes
1 answer
64 views

Quantitatively distinguishing between multiple-comparison tests

As someone relatively new to applied statistics, I have been trying to better understand some of the best practices for applying statistical methods. I have been recently trying to understand when to ...
Argon's user avatar
  • 153
0 votes
0 answers
18 views

Multiple comparisons (i.e., cluster 1 vs cluster 2+3), how to adjust p-value

I am analyzing the differences in mean of a continuos variable between 3 clusters. I used anova (after testing whether it has a parametric distribution) and obtained p-value lower than 0.05. As post-...
user406121's user avatar
0 votes
0 answers
30 views

FDR q-values interpretation

In performing 43 test on two groups of individuals (independent t-test) I obtained 27 significant results, then adjusting the pvalues with BH procedure for controlling FDR I obtained the so-called q-...
Ed9012's user avatar
  • 391
0 votes
0 answers
34 views

Is it necessary to perform correction on confidence intervals of some specific coefficients of different models on same dataset?

I have a dataset which is about daily death rate of a specific disease and meteorological data: The dataset structure is as below: data = Death count Daily pm2.5 (lag 0) Daily pm2.5 (lag 1) Daily pm2....
doraemon's user avatar
  • 250
1 vote
0 answers
22 views

Bonferroni-Dunn Critical differences

I was reading about visualizing post-hoc tests and I happened to come across a Python package called Orange. Looking into the package, the function used for calculating the CD value seems to be ...
girlinterrupted123's user avatar
6 votes
1 answer
88 views

Which family-wise correction is needed for one-sided t-tests in a randomized controlled trial with several independent measures across groups?

I conducted a randomized controlled experiment with groups $A$, $B$, $C$, and $D$, each containing around $40$ human participants who saw one of four variants of a website. Group $A$ saw a baseline, ...
Jeroen's user avatar
  • 161
4 votes
2 answers
275 views

Am I right that the Bonferroni correction does NOT apply to randomness testing?

There are statistical test suites (below) that are commonly used to determine whether a sequence appears to be (pseudo) random. Some of these test suites have a few tests (ent/ent3000), whilst others ...
Paul Uszak's user avatar
0 votes
0 answers
11 views

Statistical model for multi-subject multi-trial group comparisons

I am quite a novice in statistics and I have a complex model (at least for me) that I need to build for a test. I have a treatment plan and I am doing some frequency measurements in different regions ...
ozzy t's user avatar
  • 1
2 votes
1 answer
87 views

Bonferroni Post-hoc after normality test following a glm()

Experiment Design Mice belonging to knock-out ($n=7$) and wild-type ($n=6$) had their food intake recorded per hour across a 24 hour period. Within this 24 hour period, the first 12 hours is labelled ...
JLit98's user avatar
  • 45
6 votes
1 answer
365 views

Applying the Benjamini-Hochberg correction with a low number of comparisons

I want to run an experiment with 4 variants (3 and a control), comparing the 3 variants to the control. I want to correct the alpha for multiple comparisons. I have 2 ways: Benjamini-Hochberg ...
David Masip's user avatar
4 votes
3 answers
489 views

Reducing threshold p-value in case of statistical tests following data exploration

Imagine, I got a new dataset. I look into it, trying to find a plausible hypothesis. During this I build charts, trying to find something interesting. Should I reduce the p-value threshold due to ...
Konstantin Solomatov's user avatar
2 votes
1 answer
162 views

Do I have to apply Bonferroni's correction here?

I'm conducting research on the treatment effect of tinnitus. Δ represents the pre-treatment to post-treatment change. ΔTHI yielded a p-value of 0.03, while the other p-values are above 0.5. Now, ...
wonderhow's user avatar
0 votes
0 answers
131 views

Kruskal-Wallis multiple testing - correction alpha

I have 10 numeric outcomes in one dataset and I want to use Kruskal-Wallis test to identify an influence via a predictor variable (group variable) and also for each age group. I am testing for each ...
user avatar
1 vote
2 answers
54 views

Do I need to use Bonferroni correction in commutation study?

I have a table like this: ...
Caterina's user avatar
  • 229
5 votes
3 answers
532 views

p value correction in multiple outcomes study

I am performing an analysis on different values of complement (in total 18, 9 in blood and 9 in CSF). We aim to analyze if any of these complement values: Differentiate between 3 diseases (Disease 1, ...
Adrián Valls Carbó's user avatar
1 vote
1 answer
24 views

Can the Bonferroni correction or another correction for multiple comparisons be used in a logistic regression?

Can the Bonferroni correction or another correction for multiple comparisons be used in a logistic regression? I have only seen it used in ANOVAs. Also, is there a test I can use in SPSS for this?
maile's user avatar
  • 11
0 votes
0 answers
231 views

Definition of 'independence' of comparisons in Multiple-Comparison - Bonferroni Adjusted Standardized Residuals for Chi-Squared Test

I have provided a hypothetical example to illustrate my question. Assume an alternate hypothesis for a difference between two variables of interest (arbitrary for the example), analyzed with a chi-...
The_Moist's user avatar
0 votes
0 answers
27 views

Bonferroni correct Application

This might be a super simple question but I cant seem to find an answer. The issue I am comparing 2 shoes at 3 speeds and their impact on a dependant variable. Therefore lets say shoe1/speed1 = A; ...
PlebHawkDown's user avatar
1 vote
0 answers
17 views

Bonferroni application [closed]

My dataset compares the impact of 2 shoes at 3 speeds on a dependant variable. When it comes to post hoc pairwise testing I would look at shoe1 vs shoe2 at every speed speed 1 vs speed 2; speed 2 vs ...
PlebHawkDown's user avatar
0 votes
0 answers
27 views

Do I need to apply the Bonferroni correction test if it's different tests on different dimensions but generated by the same agents?

I am running an AB test on a customer support tool - I have changed one feature in the support tool. My unit of randomisation is the agent solving tickets, and my unit of measurement is tickets solved....
Alan's user avatar
  • 1
0 votes
0 answers
39 views

Multiple testing with Wilcoxon signed rank test with set maximum length

I'm essentially performing this test with the Java Apache math3 method which only allows lengths up to 30. My pairs will have a length of maximum 2048. I will be testing for an increase (combination ...
Elias Murcray's user avatar
2 votes
1 answer
98 views

KPSS test with Bonferroni Correction. alpha < 0.01

I want to apply a Bonferroni correction on multiple KPSS tests for stationarity. I have $m$ tests, and so I want to see if the p-values are less than $0.01/m$. The problem is that the statistical ...
chasmani's user avatar
  • 165
1 vote
0 answers
43 views

Alternative to Bonferroni Correction for Dichotomous Variable? [closed]

I am working with a dichotomous variable and my supervisor has asked me to apply a Bonferroni correction to our data using SPSS. From my understanding, Bonferroni corrections are used when performing ...
Jorge A's user avatar
  • 87
0 votes
1 answer
191 views

Is that necessary to do multiple test correction on mediation analysis

I'm doing a mediation analysis to find the 'significant' mediator between variables X and Y. I have 4 potential mediators (M1,M2,M3,M4) and I conducted 4 univariate mediation analysis. More ...
user392637's user avatar
0 votes
1 answer
193 views

Bonferroni correction, alpha and C.I [closed]

For multiple comparisons, Bonferroni corrections are made. Depending on the number of pairs of comparisons, the level of significance is adjusted. For instance, for 4 pairs of comparisons at 95% C.I., ...
user392051's user avatar
1 vote
2 answers
2k views

Non-parametric test for comparing means of 2 or more dependent variables in R?

I have a matched paired dataset (student survey before a topic was taught and student survey after the same topic was taught) where I compare the means of their answers (answers are given in Likert ...
user avatar
0 votes
0 answers
50 views

Does the Holm-Bonferroni procedure really correct for FWER in the context of ANOVA?

I wanted to make sure that post-hoc tests with the Holm-Bonferroni procedure behave nominally on typical ANOVA data under the null hypothesis. To do so, I computed the p-values and FWER obtained from ...
larmor's user avatar
  • 33
1 vote
1 answer
85 views

Meta analysis: can multiple test corrections (i.e. Bonferroni) be applied on the pooled effect p-value?

I plan to do a meta-analysis including the effect size of each cohort as the objectives. I'd like to ask if I could apply multiple test corrections (i.e. Bonferroni) on the pooled effect p-value. I ...
Joe's user avatar
  • 21
0 votes
0 answers
105 views

Do we need to apply "multi-testing" corrections for the p-values in a regularized model?

Say we are fitting a penalized model, such as a linear regression with lasso regularization. We expect to obtain a model with the most significant covariables. The method starts with many covariables ...
skan's user avatar
  • 1,074
2 votes
1 answer
43 views

Bonferroni Correction: Independence vs Disjoint Events

Let $T_i$ and $c_i$ be a test statistic and critical value, respectively, for testing hypothesis $H_i$, $i = 1,2,\dots, n$. Assume a Type-1 error rate of $\alpha$ for each test. The family-wise error ...
Syd Amerikaner's user avatar
1 vote
1 answer
94 views

family wise error rate in highly dependent data

I was hoping someone could help with a problem in my area of Optometry. We use visual fields/perimetry to assess patients visual function. This consists of patient responses (or not) to points of ...
holmes's user avatar
  • 61
1 vote
0 answers
14 views

posthoc paired t test

Is there a website with a calculator to input 2 sets of data to perform the post paired t test adjusted with the Bonferroni correction? Or is anyone available to hire?
dr blade's user avatar
1 vote
1 answer
36 views

Pre-specified comparisons procedure: How comparisons can be made without looking at the data

The section "Bonferroni Comparisons" in the book Applied Statistics for Engineers and Scientists, Petruccelli at el. (1999), the authors wrote: Bonferroni intervals are ideal for making a ...
Tran Khanh's user avatar
4 votes
1 answer
402 views

Bonferroni corrected p-values that exceed 1: possible or non-sense?

My question concerns the Bonferroni correction of p-values. In my analysis, I would like to multiply the obtained p-values by N, where N is the chosen number for the Bonferroni correction, such as 2, ...
Philipp's user avatar
  • 307
1 vote
0 answers
477 views

How to correct for multiple testing in linear mixed models?

I want to correct for alpha error accumulation for my 10 crossed linear mixed models. The random parameters are specified as follows: random intercepts for subject and stimulus and a random slope for ...
CapsLock's user avatar
2 votes
1 answer
87 views

Bonferroni correction: Whats exactly is meant by "multiple tests"? [duplicate]

The Bonferroni correction seems to be quite controversial. But I read again and again that it should be used for multiple tests. But what exactly are multiple tests? If I have three different data ...
Concetta's user avatar
1 vote
0 answers
57 views

Why is an alpha adjustment not required for factorial ANOVA?

When conducting a 2-way fixed effects ANOVA, there are essentially four null hypothesis statistical tests (NHSTs) that can reasonably conducted with just the ANOVA tables. The first is the omnibus ...
Gregg H's user avatar
  • 5,544
0 votes
0 answers
50 views

Adjusted p-value for conducting 7 linear regression models?

I am looking at factors that are associated to changes in student's grades over time. My dataset consists of 45 students with Time 1 and Time 2 grades across 7 different subjects as well as ...
user382780's user avatar
1 vote
1 answer
276 views

How to get the group differences after Bonferroni correction in multiple comparison?

After an ANOVA in R, do you know if it is possible to get the group differences using Bonferroni correction ? If I use the iris dataset ...
Xav64's user avatar
  • 169
0 votes
0 answers
41 views

ANOVA: which test is to be chosen when they differ in significance?

I am using the software PAST*. When running an ANOVA I have available these tests: Tuckey's pairwise, Kruskal-Wallis, Mann-Whitney pairwise and Dunn's post hoc. I am trying to see if three species are ...
dandelion's user avatar
2 votes
2 answers
71 views

In a muddle with Paired Samples t-tests on pre vs during vs post

I have used paired samples t-tests to compare 3x time-point measurements, A/ B/ C. A and B t(102)=4.988 p=.000 A and C t(102)=4.939 p=.000 B and C t(102)=.346 p=.730 A, B, and C were all significant ...
Stats_Apprentice's user avatar
2 votes
1 answer
275 views

Reviewer is requesting the use of Bonferroni adjustment to alpha in G*power calculation ("multiple regression" with 3 predictors)

Since Bonferroni is intended as a (conservative) adjustment to reduce Type 1 error, I'm unclear why it would be required by the reviewer to adjust alpha in the power calculation (using G*power). While ...
J Gates's user avatar
  • 21
4 votes
1 answer
743 views

Questions about Dunn's test

Authors in a paper state that they use the 'Bonferroni-Dunn test' as a post-hoc test. Is the 'Bonferroni-Dunn test' just a Dunn's test with Bonferroni adjustment or is it a different test (after ...
user378377's user avatar

1
2 3 4 5
9