Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

Filter by
Sorted by
Tagged with
0
votes
1answer
30 views

How to adjust P-Value for Multiple Tests

I'm not sure if this is answered or not because there's a lot of these questions and the ones I looked at didn't answer this. If I were to say, have five independent variables of interest and one ...
3
votes
1answer
24 views

Considering pre-tests in family-wise error correction doing an ANOVA

When I do multiple tests on a dataset, I need to correct for the family-wise error (e.g. using Bonferroni method when performing multiple pairwise t-tests). If I do an ANOVA, I need to make sure that ...
0
votes
0answers
16 views

Apply Fisher's exact test on multiple class

I am testing the presence of viruses within samples, which are matched 'normal', 'cancer' and 'metastasis'. I am testing the presence of viruses at species, family and order level. For instance, I ...
0
votes
0answers
25 views

Is it necessary to adjust for multiple comparisons (e.g. Bonferroni) when using continuous interaction terms (e.g. age)?

I am interested in analyzing how the effect of a dichotomous variable on a dichotomous outcome changes by age. In reading this how-to article from UCLA's Institute for Digital Research & Education-...
0
votes
1answer
35 views

Adjusting p-values for multiple comparisons: if Bonferroni adjustment = α/??, what's my?

I'm testing the effect of two different informational treatments on individuals' attitudes towards certain policies. I know I need to adjust my p-values for multiple comparisons. Using the ...
1
vote
1answer
44 views

Confidence intervals and bonferroni correction

Currently I'm thinking about using confidence intervals to compare the difference in means between a few groups. However, if I understand correctly I need to use the Bonferroni correction if I test ...
4
votes
1answer
180 views

What is the right Bonferroni adjustment?

I am trying to test a hypothesis for my Masters Thesis. There are 3 conditions (I will name them X, Y, Z), in each of which the data isn't normally distributed, and measures the improvement for each ...
0
votes
2answers
31 views

Multivariate post-hoc tests and multiple comparisons

My research group is currently working on a medical imaging project in which we are studying brain perfusion in patients affected and unaffected by a particular type of injury using a technique called ...
0
votes
0answers
39 views

Fisher's Exact Test and bonferroni correction in r

I try to find out whether there are significant differences in Categories between several groups. My data looks like: ...
2
votes
2answers
104 views

How to select the best variant from an A/B/C test?

Suppose I've run an A/B/C experiment (same as A/B but with 3 groups instead of 2) and gathered the following data for number of participants in each group and number of desired actions in each group (...
0
votes
0answers
10 views

correct for multiple testing on correlated data with NaNs

First of all, I'm not a statistics expert, so I hope I can describe all relevant details of my problem: I'm working with a dataset consisting of subject age (1st column), 13 ordinal scaled parameters ...
0
votes
0answers
26 views

Need of p-value adjustment when analyzing all possible pairs of factor levels in linear model

I have a nominal (not ordinal) variable with $K$ levels (these are actualy some groups of patients) and I run linear model in which: this nominal variable is one of IV's (others are age, sex and so ...
0
votes
0answers
15 views

2 sample t-test with multiple tasks Bonferroni correction?

Let's say I have a between-subject design with 2 conditions (male, female) and I want to test if: males solve math tasks faster than females. males do less errors when solving the task I am ...
0
votes
1answer
24 views

Using bonferroni with t.tests & regression

I have theoretical knowledge of why we should use bonferroni; however, unfortunately not how. I am conducting multiple t.tests, sometimes within the main data (number of t.tests = 5, number of main ...
1
vote
0answers
15 views

3 way ANOVA / Duncan test

I am runnig 3 way ANOVA between: specie * organ * treatment in Sucrose acumulation. There is interaction between organ*treatment, but no interaction between specie and organ or treatment. Should I ...
0
votes
0answers
16 views

Non replicated vs replicated field trial

I need to conduct a pesticide efficacy trial on avocados. I have been asked to describe two different trial approaches: replicated and non replicated. I have drawn the two trial design options. ...
0
votes
0answers
53 views

Bonferroni for Wilcoxon signed rank?

I conducted a survey that asked participants to rate their level of agreement on a 5 point Likert scale with nine items (1=strongly agree, 5=strongly disagree). Hence, a mean score of 3 would mean ...
0
votes
0answers
17 views

What is function of Holm-Bonferroni? [duplicate]

I am confused about Holm-Bonferroni. Suppose we want to compare age of female and male students using t tset. We also want to compare length of arm and elbow between male and female students. I ...
1
vote
1answer
49 views

Correcting for multiple 2-way anova testings (each IV only has two levels)

I have two independent variables, both of them only have 2 levels (Story type: Homosexual vs. Heterosexual, and Stereotype: High vs. Low). I run three two-way ANOVAS, to test the IVs' effects on ...
0
votes
1answer
19 views

Defining my number of multiple comparisons for a Bonferroni correction

I'm a grad student doing analysis on a survey. One of the things I want to note from this study is whether demographic factors of respondents are connected to the answers they gave (how do men or ...
7
votes
1answer
191 views

Multiple comparisons correction for dependent comparisons

In this blog post the authors discuss simultaneously estimating quantiles, and constructing a simultaneous confidence envelope for the estimation which covers the whole quantile function. They do this ...
0
votes
1answer
39 views

Twenty samples should be the same. But How should I test that

I have a table derived from a group of polypeptides or proteins. Because they are proteins they are made up of 20 amino acids. Iff a group of proteins contains a random sample of amino acids then the ...
0
votes
0answers
34 views

Applying Bonferroni or Holm-Bonferroni correction to interaction effects and simple slopes

I am seeking to apply a correction to my exploratory analyses to account for familywise error. I am conducting moderated MRAs with 7 different moderators, 1 IV, and 1 DV. I am interested in ...
0
votes
0answers
64 views

Can Bayes factors be an alternative to multiple comparisons corrections?

I am currently using p-values and Bayes factors to interpret my results. I have multiple comparisons so was going to perform a Bonferroni correction, however I am hesistant due to its highly ...
1
vote
0answers
40 views

Bonferroni confidence region for shifted Laplace parameters

Consider the shifted Laplace distribution with the density: $$f(y)=\frac{\theta}{2}e^{-\theta|y-\mu|}\quad, \quad y\in \mathbb R$$ Using the Bonferroni method, construct a $100(1-\alpha)\%$ ...
0
votes
1answer
31 views

How to interpret a statistically signficant finding that becomes unsignificant after bonferroni correlation

I hypothesised I would find a main effect of X which I did (p=0.028), however, upon using the bonferroni correction my alpha dropped to 0.0125, making this result no longer significant. I found a ...
1
vote
1answer
138 views

Is it necessary to do a Bonferroni correction on a) exploratory analysis b) correlations or c) if there are 3 different dependent variables

My study is a 2x2 within design and I have a series of 8 hypotheses. These include one ANOVA , one t-test and 4 Pearson correlations. However, the ANOVA and 3 of the correlations include the same ...
0
votes
0answers
22 views

Compensate for multiple experiments or not

My last question let to some confusion about the source of my data, so I will do my best to explain the experiment from the beginning. It starts with a game (game theory), let’s say a cooperation ...
0
votes
0answers
25 views

Significant interaction in Mixed-design 2-way ANOVA. How to correct for multiple comparisons?

I have conducted a mixed-design two-way ANOVA (between subjects variable : 2 levels; within subjects variable : 8 levels). I have a significant main effect of between and within subject variables and ...
1
vote
0answers
7 views

Can and should you avoid implicit pretesting for differences in group means?

Suppose I have a population with four (or more) disjoint sub-populations which differ from one another by traitishness, the union of which is the whole population. I have an outcome measure on the ...
1
vote
1answer
85 views

Holm-Bonferroni correction with two interactions

I try to get a sense of the correct adjusted Holm-Bonferroni significance levels $\alpha$ when dealing with multiple interaction terms. To simplify, assume one has the following model: $$ y=\beta_0 + \...
3
votes
1answer
105 views

alpha value in Bonferroni corrected test

I ran some analysis with Bonferroni corrected test in R. Now my supervisor asked me what the value for alpha is for my analysis and since I haven't changed the default value it should be same as ...
0
votes
1answer
47 views

Correcting for multiple post hoc tests in factorial ANOVA

I have done a two-way repeated-measures ANOVA with factor A having 3 levels and factor B having 5 levels. I am doing post hoc comparisons between all 3 levels of factor A within each of the 5 levels ...
1
vote
0answers
377 views

Pairwise comparisons after ANOVA with Tukey and Bonferroni methods in r

The built-in functions TukeyHSD and LSD.test from R perform pairwise comparisons. In order to maintain the type I error, the significance level $0.05$ is divided by the number of comparisons $k$. Do ...
1
vote
0answers
121 views

FIsher's LSD test is appropriate for restricted mean comparisons

Suppose that we perform two way ANOVA with interactions, with factors $A$ and $B$ with three level each $A_{1},A_{2},A_{3}$ and $B_{1},B_{2},B_{3}$. We know that Fisher's LSD test is used for ...
2
votes
1answer
39 views

Repeated measures models multiple testing adjustment

Perhaps I am missing something obvious here, but I can't find an answer to this. Let's say we run 10 individual repeated measures models with factor(time) as fixed effect with 5 separate timepoints ...
1
vote
1answer
29 views

Bonferroni interval - quick example calculation

Problem statement: Calculate the Bonferroni interval for any pair of means $\bar{y}_{.j},\bar{y}_{.k}$ with $I$=10 groups with equal sample size 30 in each group. Write this as a multiple of $s$. ...
0
votes
1answer
24 views

evaluate relationship between 1 independent variable and multiple dependent variables.

To evaluate the relationship between variables coefficient of correlation and coefficient of determination obtained from regression are used. But what is the procedure if I have 1 Independent variable ...
0
votes
1answer
70 views

multiple comparison with controls - kruskall wallis or mann whitney + bonferroni

I have a test group and two control groups. I would like to compare: test vs control group 1 test vs control group 2 and I don't need the result from control group 1 vs group 2. Therefore, in this ...
1
vote
1answer
225 views

Bonferroni-type corrections and Fisher Method Meta-analysis

I'm not an expert on the field, but I need to know more about how to combined multiple significance test p-values after a two sample Kolmogorov Smirnov (KS)test on two distributions. But I have two ...
0
votes
0answers
47 views

T-tests vs multiple comparison tests vs bonferroni in ANOVA?

I'm taking a course in experiment design and I'm having a hard time grasping the comparative usefulness of t-tests, multiple compariseon tests and bonferroni methods. I understand that in using ...
0
votes
2answers
44 views

Bonferroni correction and discussion of the results

In a study in which I analyze several biomarkers through logistic and linear regressions, should I discuss in the discussion of the paper the results with p <0.05 (they only have a nominal ...
0
votes
1answer
1k views

R - Bonferroni correction with p.adjust(), what's the correct n value?

I am trying to get the Bonferroni correction right. Let's suppose I have a dataset with 100 p-values, 20 significant at minimum the 10% level (p-value < 0.1) and 80 not significant (p-value >= 0.1)...
1
vote
0answers
70 views

P values all equal to 1 after using bonferroni or hommel

Several topics are talking about this but in my case my p values are generated differently. My p values will be calculated simulating $N$ (in this case 5000) random gene groups of size $g$ of the ...
2
votes
2answers
762 views

Wilcoxon test with multiple testing: which correction for p values?

Please, I'm not very confident in statistics, and I'm trying to respond to a reviewer for a paper on the following issues: In my experiment I observed 15 babies during a test where they were free to ...
2
votes
1answer
267 views

Bonferroni correction: how does it work?

I already read the answers here: About the Bonferroni correction, but I still don't understand the concept completely. Assume the following hypothetical case, where I perform an ANOVA test to ...
0
votes
2answers
89 views

How to Control Familywise Error Rate in a series of Planned McNemar Comparisons

I have paired binary responses from same subjects under 9 different conditions. I conducted Cochran's Q which indicated that there significantly different pairs exist. I want to follow up but NOT ...
0
votes
0answers
249 views

Bonferroni correction for pairwise proportion comparisons for more than one outcome level

Suppose I have an event that can have 3 different outcomes. This event is recorded for 21 different factor levels for a total of 100 times, and each time an outcome happens it is counted (so I am ...
0
votes
1answer
972 views

Multiple paired t-tests. Bonferroni number of comparisons?

I have done 9 paired t-tests, to see if there are significant changes in pre and post measurements of three variables (FFMQ-SF, GSE, WEMWBS), across three groups (Engagement level: minimum, medium, ...
0
votes
2answers
88 views

Unusual Bonferroni correction

Assume my hypothesis is: "Light supports the performance of students." The experimental setting consists of two room conditions that students are randomized to. The "light" group takes a test in a ...