Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

1
vote
0answers
29 views
+100

Multiple comparisons correction for dependent comparisons

In this blog post the authors discuss simultaneously estimating quantiles, and constructing a simultaneous confidence envelope for the estimation which covers the whole quantile function. They do this ...
0
votes
1answer
37 views

Twenty samples should be the same. But How should I test that

I have a table derived from a group of polypeptides or proteins. Because they are proteins they are made up of 20 amino acids. Iff a group of proteins contains a random sample of amino acids then the ...
0
votes
0answers
10 views

Applying Bonferroni or Holm-Bonferroni correction to interaction effects and simple slopes

I am seeking to apply a correction to my exploratory analyses to account for familywise error. I am conducting moderated MRAs with 7 different moderators, 1 IV, and 1 DV. I am interested in ...
0
votes
0answers
41 views

Can Bayes factors be an alternative to multiple comparisons corrections?

I am currently using p-values and Bayes factors to interpret my results. I have multiple comparisons so was going to perform a Bonferroni correction, however I am hesistant due to its highly ...
0
votes
0answers
12 views

Bonferroni confidence region for shifted Laplace parameters

Consider the shifted Laplace distribution with the density: $f(y)=\frac{\theta}{2}e^{-\theta|y-\mu|}$ $y\in \Re$ Using the Bonferroni method, construct a $100(1-\alpha)\%$ confidence region for $(\...
0
votes
1answer
26 views

How to interpret a statistically signficant finding that becomes unsignificant after bonferroni correlation

I hypothesised I would find a main effect of X which I did (p=0.028), however, upon using the bonferroni correction my alpha dropped to 0.0125, making this result no longer significant. I found a ...
1
vote
1answer
46 views

Is it necessary to do a Bonferroni correction on a) exploratory analysis b) correlations or c) if there are 3 different dependent variables

My study is a 2x2 within design and I have a series of 8 hypotheses. These include one ANOVA , one t-test and 4 Pearson correlations. However, the ANOVA and 3 of the correlations include the same ...
0
votes
0answers
19 views

Compensate for multiple experiments or not

My last question let to some confusion about the source of my data, so I will do my best to explain the experiment from the beginning. It starts with a game (game theory), let’s say a cooperation ...
0
votes
0answers
12 views

Significant interaction in Mixed-design 2-way ANOVA. How to correct for multiple comparisons?

I have conducted a mixed-design two-way ANOVA (between subjects variable : 2 levels; within subjects variable : 8 levels). I have a significant main effect of between and within subject variables and ...
1
vote
0answers
7 views

Can and should you avoid implicit pretesting for differences in group means?

Suppose I have a population with four (or more) disjoint sub-populations which differ from one another by traitishness, the union of which is the whole population. I have an outcome measure on the ...
1
vote
1answer
52 views

Holm-Bonferroni correction with two interactions

I try to get a sense of the correct adjusted Holm-Bonferroni significance levels $\alpha$ when dealing with multiple interaction terms. To simplify, assume one has the following model: $$ y=\beta_0 + \...
3
votes
1answer
39 views

alpha value in Bonferroni corrected test

I ran some analysis with Bonferroni corrected test in R. Now my supervisor asked me what the value for alpha is for my analysis and since I haven't changed the default value it should be same as ...
0
votes
1answer
38 views

Correcting for multiple post hoc tests in factorial ANOVA

I have done a two-way repeated-measures ANOVA with factor A having 3 levels and factor B having 5 levels. I am doing post hoc comparisons between all 3 levels of factor A within each of the 5 levels ...
1
vote
0answers
191 views

Pairwise comparisons after ANOVA with Tukey and Bonferroni methods in r

The built-in functions TukeyHSD and LSD.test from R perform pairwise comparisons. In order to maintain the type I error, the significance level $0.05$ is divided by the number of comparisons $k$. Do ...
1
vote
0answers
61 views

FIsher's LSD test is appropriate for restricted mean comparisons

Suppose that we perform two way ANOVA with interactions, with factors $A$ and $B$ with three level each $A_{1},A_{2},A_{3}$ and $B_{1},B_{2},B_{3}$. We know that Fisher's LSD test is used for ...
2
votes
1answer
33 views

Repeated measures models multiple testing adjustment

Perhaps I am missing something obvious here, but I can't find an answer to this. Let's say we run 10 individual repeated measures models with factor(time) as fixed effect with 5 separate timepoints ...
1
vote
1answer
27 views

Bonferroni interval - quick example calculation

Problem statement: Calculate the Bonferroni interval for any pair of means $\bar{y}_{.j},\bar{y}_{.k}$ with $I$=10 groups with equal sample size 30 in each group. Write this as a multiple of $s$. ...
0
votes
1answer
17 views

evaluate relationship between 1 independent variable and multiple dependent variables.

To evaluate the relationship between variables coefficient of correlation and coefficient of determination obtained from regression are used. But what is the procedure if I have 1 Independent variable ...
0
votes
1answer
47 views

multiple comparison with controls - kruskall wallis or mann whitney + bonferroni

I have a test group and two control groups. I would like to compare: test vs control group 1 test vs control group 2 and I don't need the result from control group 1 vs group 2. Therefore, in this ...
1
vote
1answer
106 views

Bonferroni-type corrections and Fisher Method Meta-analysis

I'm not an expert on the field, but I need to know more about how to combined multiple significance test p-values after a two sample Kolmogorov Smirnov (KS)test on two distributions. But I have two ...
0
votes
0answers
25 views

T-tests vs multiple comparison tests vs bonferroni in ANOVA?

I'm taking a course in experiment design and I'm having a hard time grasping the comparative usefulness of t-tests, multiple compariseon tests and bonferroni methods. I understand that in using ...
0
votes
2answers
39 views

Bonferroni correction and discussion of the results

In a study in which I analyze several biomarkers through logistic and linear regressions, should I discuss in the discussion of the paper the results with p <0.05 (they only have a nominal ...
0
votes
0answers
53 views

Defining “family” in the Family Wise Error Rate (FWER) correction

I know that the term "family" in FWER isn't defined very clearly in the literature and although one definition that is widely accepted, "All tests that are performed", a lot of applied statisticians ...
0
votes
1answer
354 views

R - Bonferroni correction with p.adjust(), what's the correct n value?

I am trying to get the Bonferroni correction right. Let's suppose I have a dataset with 100 p-values, 20 significant at minimum the 10% level (p-value < 0.1) and 80 not significant (p-value >= 0.1)...
1
vote
0answers
61 views

P values all equal to 1 after using bonferroni or hommel

Several topics are talking about this but in my case my p values are generated differently. My p values will be calculated simulating $N$ (in this case 5000) random gene groups of size $g$ of the ...
2
votes
2answers
221 views

Wilcoxon test with multiple testing: which correction for p values?

Please, I'm not very confident in statistics, and I'm trying to respond to a reviewer for a paper on the following issues: In my experiment I observed 15 babies during a test where they were free to ...
2
votes
1answer
229 views

Bonferroni correction: how does it work?

I already read the answers here: About the Bonferroni correction, but I still don't understand the concept completely. Assume the following hypothetical case, where I perform an ANOVA test to ...
0
votes
2answers
54 views

How to Control Familywise Error Rate in a series of Planned McNemar Comparisons

I have paired binary responses from same subjects under 9 different conditions. I conducted Cochran's Q which indicated that there significantly different pairs exist. I want to follow up but NOT ...
0
votes
0answers
176 views

Bonferroni correction for pairwise proportion comparisons for more than one outcome level

Suppose I have an event that can have 3 different outcomes. This event is recorded for 21 different factor levels for a total of 100 times, and each time an outcome happens it is counted (so I am ...
0
votes
0answers
19 views

Type-I error adjustment for simple effects when 2x3 factorial ANOVA interaction only is significant

I have found several questions and answers that skirt around my problem but I haven't been able to deduce a clear solution. My situation is this: I ran an experiment with a 2x3 factorial design (call ...
0
votes
1answer
307 views

Multiple paired t-tests. Bonferroni number of comparisons?

I have done 9 paired t-tests, to see if there are significant changes in pre and post measurements of three variables (FFMQ-SF, GSE, WEMWBS), across three groups (Engagement level: minimum, medium, ...
0
votes
2answers
62 views

Unusual Bonferroni correction

Assume my hypothesis is: "Light supports the performance of students." The experimental setting consists of two room conditions that students are randomized to. The "light" group takes a test in a ...
1
vote
1answer
57 views

comparing the means of multiple distributions

I wish to compare the means of three independent data sets. These are exam scores that are from class A and class B and class C. Class A and B are normal and tested ok for homogeneity. A T-Test ...
0
votes
0answers
35 views

Multiple comparison correction, when?

I am not sure about how many test I have in the following scenario: I collect 3 measures of a persons performance in a task (m1, m2, m3). I also collect data on two anatomical features (A1, A2). Then ...
1
vote
1answer
24 views

Multiple hypothesis test

I have some questions about multiple hypothesis test. Situation 1: We have 1000 p-values, all of them are less than 0.0 5. We may say there are 50 false positive (1000*0.05) in these p-values. ...
0
votes
0answers
55 views

Bonferroni/Holm correction when performing chi-squared residual analysis

Let's say I am performing two t-tests and one chi-squared test for a 5*2 table (for example levels of education vs. sex). I am further interested in which categories of education differ among sexes, ...
1
vote
0answers
95 views

Chi-square difference test: how to adjust for the number of tests?

How should I adjust for the number of tests I do when using the chi-square difference test, where the null hypothesis of the test is that two models do not differ? I am using this test in the context ...
1
vote
0answers
68 views

How and when to use multiple comparison tests

There seems to be some variability in WHEN multiple comparison tests such as Bonferroni or FDR might be implemented. Type 1: One might carry out multiple one-way ANOVA's to see whether or not there ...
0
votes
0answers
19 views

bonferroni adjustment with multiple groups

I have 3 categorical metrics on cars Quality (values are high, medium , low) , Reliability (values are high,medium, low), Avg Life (long, medium, short) and I have 4 groups A,B, C,D and they give ...
0
votes
0answers
12 views

Error correction within factorial GLMMs

Below is toy-data and analysis for a bog-standard factorial longitudinal GLMM ...
0
votes
0answers
131 views

Adjustment for multiple tests for a mediation with multiple DVs? (Process/SPSS)

I hope my question has not been addressed in another post; I could not find any response to my issue. I'm conducting a mediation analysis with 1 IV (X), 1 mediator (M), and 4 DVs (Y). I use Process, ...
0
votes
1answer
170 views

Bug in SPSS bonferroni correction?

I just read some topics that discuss how SPSS corrects the p value shown and it keeps 0.05 as significant when applying bonferroni correction. The problem that I have is that I'm running a repeated ...
0
votes
0answers
36 views

How to use Bonferroni correction - correct by no of parameters? No of models per dependent variable?

I have a simple question about when corrections such as Bonferroni should be applied. Say I have a research question for which I have three separate dependent variables, and run three separate models ...
0
votes
1answer
780 views

85% Bonferroni family-wide (simultaneous) CI for lm in R

The code confint(model, level = 1 -0.15/length(coef(model))) was recommended by https://stat.ethz.ch/pipermail/r-help/2005-March/067570.html However, I have ...
1
vote
1answer
277 views

Bonferroni correction for Wilcoxon signed rank test with 6 related samples?

I am comparing scores of the same group of people over 7 days. I first did a Friedman's test to know where the differences were between the 7 days and I did a Wilcoxon signed rank test for the Post ...
1
vote
1answer
64 views

Should P-values of continuous variables be corrected?

Usually, when doing multiple tests to compare means of categorical variables, it is advised to do some correction of the P-values to control the probability or proportion of false positives (...
0
votes
0answers
31 views

Do I need to “correct”?

I am testing whether a certain learning intervention affects student achievement. I have two groups of students (control and experimental) with 16 students each. I have their pre-test and post-test ...
2
votes
1answer
111 views

p-value Inequality?

I was trying to go over this paper by Dudoit, Shaffer and Boldric when I came across this statement on page 78 (under section 2.4: Control of family-wise error rate): $P(P_j\leq x \vert H_j)\leq x,$ ...
0
votes
1answer
183 views

Bonferroni correction vs. asterisks signifying significance levels

There is convention concerning the use of asterisks to represent levels of significance. I am sure there are others, but let's stick to this one for now: Convention for symbols indicating statistical ...
1
vote
2answers
389 views

Bonferroni correction: elementary question: when do I reject?

Question practically rewritten as from some answers&comments became clear that I am not understanding the semantics and context. The "procedure" for Bonferroni is clear to me, my problem is a ...